US 6,330,584 B1Grant
Systems and methods for multi-tasking, resource sharing and execution of computer instructions
Issue Date:2001-12-11
•40 Claims
•15 Drawing Sheets
Abstract
In a multi-tasking pipelined processor, consecutive instructions are executed by different tasks, eliminating the need to purge an instruction execution pipeline of subsequent instructions when a previous instruction cannot be completed. The tasks do not share registers which store task-specific values, thus eliminating the need to save or load registers when a new task is scheduled for execution. If an instruction accesses an unavailable resource, the instruction becomes suspended, allowing other tasks' instructions to be executed instead until the resource becomes available. Task scheduling is performed by hardware; no operating system is needed. Simple techniques are provided to synchronize shared resource access between different tasks.
Metadata
Assignee
- MMC Networks, Inc.
Inventors
- Alexander Joffe
- Dmitry Vyshetsky
Application Information
Application Number:US 09/055,033
Filing Date:1998-04-03
Priority Date:1998-04-03
Art Unit:7
Classifications
IPC:
G06F 900
Field of Search:
709108709100709101709102709103709104709107709227707500707503
Patent Drawings (15 sheets)
Description
CROSS REFERENCE TO RELATED APPLICATIONS
[0002] Not applicable.
STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR DEVELOPMENT
[0003] Not applicable.
BACKGROUND OF THE INVENTION
[0004] The present invention relates to data processing, and more particularly to pipelined instruction execution, multi-tasking, and resource access techniques.
[0005] Pipelining and multi-tasking increase processor bandwidth. It is desirable to reduce the time and complexity associated with these techniques.
[0006] In particular, when instruction execution is pipelined, the processor may start executing an instruction before it is known whether the instruction should be executed. For example, suppose the processor starts executing an instruction I1, and then starts executing an instruction I2 before the I1 execution is finished. If the I1 execution cannot be completed, the instruction I2 should not be executed and has to be purged from the pipeline. In fact, at any given time, the processor may be executing more than one instruction that have to be purged from the pipeline. It is desirable to reduce the circuit complexity associated with pipeline purging.
[0007] It is also desirable to reduce the overhead associated with switching between different tasks in multi-tasking environments. To switch tasks, the operating system executed by the processor has to determine which task is to be executed next. The operating system also has to save register values used by one task and load the registers with values used by another task. These functions can involve a fair number of operating system instructions. It is desirable to reduce the number of instructions associated with these operations.
[0008] It is also desirable to improve access to resources which maybe unavailable. An example of such a resource is a FIFO which may be empty when a processor is trying to read it, or which may be full when the processor is trying to write the FIFO. Before accessing the FIFO, the processor polls a flag indicating whether the FIFO is available. It is desirable to improve the speed of accessing a resource which may be unavailable.
[0009] It is also desirable to provide simple synchronization methods to synchronize use of computer resources by multiple tasks to avoid errors that could be caused by a task accessing a resource when the resource is set for access by a different task.
SUMMARY
[0010] The present invention provides in some embodiments efficient pipeline processors, multi-tasking processors, and resource access techniques.
[0011] In some instruction execution pipeline embodiments, the pipeline purge overhead is reduced or eliminated by limiting the number of instructions that the processor can execute in a row for any given task. Thus, in some embodiments, consecutive instructions are executed by different tasks. Therefore, if an instruction cannot be executed, the next instruction still has to be executed because the next instruction belongs to a different task. Therefore, the next instruction is not purged from the pipeline.
[0012] In some embodiments, between any two instructions of the same task the processor executes a sufficient number of instructions from different tasks to eliminate any need for pipeline purging.
[0013] To reduce the overhead associated with task switching, some embodiments include separate registers for each task so that the register values do not have to be saved or restored in task switching operations. In particular, in some embodiments, each task has a separate program counter (PC) register and separate flags. In some embodiments, the task switching is performed by hardware in one clock cycle.
[0014] In some embodiments, a processor can access a resource without first checking whether the resource is available. If the resource is unavailable when the processor executes an instruction accessing the resource, the processor suspends the instruction, and the processor circuitry which was to execute the instruction becomes available to execute a different instruction, for example, an instruction of a different task.
[0015] Thus, in some embodiments, the processor keeps track of the state of all the resources (for example, FIFOs). (Unless specifically stated otherwise, the word “resource” as used herein means something that may or may not be available at any given time.) Signals are generated indicating the state of each resource, and in particular indicating which resource is available to which task. If a task attempts to access an unavailable resource, the task is suspended, and the processor can execute other tasks in the time slot that could otherwise be used by the suspended task. When the resource becomes available, the suspended task is resumed, and the instruction accessing the resource is re-executed.
[0016] To avoid synchronization errors when multiple tasks share one or more resources, in some embodiments after a task has finished accessing any one of the resources, the task does not get access to the same resource until after every other task sharing the resource has finished accessing the resource. Thus, in some network embodiments, different tasks share FIFO resources to process frames of data. Each task processes a separate frame of data. To process the frame, the task reads the frame address from a “request” FIFO. Then the task writes a command FIFO with commands to a channel processor to process the frame. A second task performs similar operations for a different frame. The first task again performs the same operations for a still different frame. If commands written for one frame get erroneously applied to another frame, the frames could be misprocessed.
[0017] To eliminate this possibility and to allow accurate matching between the frame addresses in the request FIFO and the commands in the command FIFO, the following technique is used. First one task (say, T1) is allowed to access both the request FIFO and the command FIFO, but no other task is allowed to access these resources. Once the task T1 has finished accessing any resource, the resource is allowed to be accessed by another task, and further the task T1 will not be allowed to access the resource again until every other task sharing the resource has finished accessing the resource. Therefore, the order of frame addresses in the request FIFO corresponds to the order of commands in the command FIFO, allowing the channel to accurately match the frame addresses with the commands. No special tag is needed to establish this match, and the match is established using FIFOs, which are simple data structures.
[0018] In some embodiments, a processor executes several tasks processing network data flows. The processor uses pipeline and task-switching techniques described above to provide high bandwidth.
[0019] Other embodiments and variations are described below. The invention is defined by the appended claims.
BRIEF DESCRIPTION OF THE DRAWINGS
[0020] FIG. 1 is a block diagram of a system including a processor according to the present invention.
[0021] FIG. 2 is a block diagram illustrating resources in the system of FIG. 1.
[0022] FIGS. 3A, 3B are timing diagrams illustrating data frame processing in the system of FIG. 1.
[0023] FIG. 4 is a logical diagram illustrating how different tasks access shared resources in the system of FIG. 1.
[0024] FIG. 5 is a block diagram of a processor used in the system of FIG. 1.
[0025] FIG. 6 illustrates an instruction execution pipeline of the processor of FIG. 5.
[0026] FIGS. 7-12 illustrate task and resource state transitions in the system of FIG. 1.
[0027] FIG. 13A, 13B are block diagrams of task control block circuitry of the processor of FIG. 5.
[0028] FIG. 14 is a memory map for the system of FIG. 1.
[0029] FIG. 15 is a data area memory map for the system of FIG. 1.
[0030] FIG. 16 is a register file map for the processor of FIG. 1.
[0031] FIG. 17 is a data memory map for the processor of FIG. 1.
[0032] FIG. 18 illustrates address generation for the data memory of FIG. 17.
[0033] FIG. 19 illustrates tree nodes in the address resolution database used by the system of FIG. 1.
DESCRIPTION OF PREFERRED EMBODIMENTS
[0034] FIG. 1 illustrates a port interface (PIF) circuit 110 including a pipelined multi-tasking processor (microcontroller) 160. Port interface 110 includes four full-duplex ports that provide an interface between ATM switch 120 and respective four Ethernet segments (not shown) each of which is connected to a corresponding MAC 130.0-130.3. In each port “x” (x=0,1,2,3) the data between the Ethernet segment and the ATM switch 120 flows through a corresponding MAC 130.x and a corresponding slicer 140.x. The slicer performs the well-known ATM SAR function, segmenting the Ethernet frame into ATM cells and appending ATM headers to the cells on the way to ATM switch, and assembling the frame from the cells on the way to the Ethernet segment. In some embodiments, the ATM switch interface to PIF 110 operates in frame mode in which the ATM switch transmits a frame of cells to a slicer 140 with no intervening cells. Slicers 140 use the AAL-5 protocol. The frame mode is described, for example, in U.S. patent application Ser. No. 08/706,104 “Cell Queuing in ATM Switches” filed Aug. 30, 1996 by A. Joffe et al. See also PCT application PCT/US97/14821 filed Aug. 28, 1997 and incorporated herein by reference.
[0035] Other embodiments of PIF 110 provide interface between other networks, not necessarily ATM or Ethernet. In some embodiments, the slicers 140 are replaced by suitable MACs.
[0036] In addition to performing protocol transformations (e.g. ATM/Ethernet transformations), PIF 110 can perform IP routing, layer-2 switching, or other processing as determined by the software executed by the PIF microcontroller 160. See the description below in connection with FIGS. 3A, 3B. See also U.S. patent application Ser. No. 09/055,044 “SYSTEMS AND METHODS FOR DATA TRANSFORMATION AND TRANSFER IN NETWORKS”, filed by A. Joffe et al. on the same date as the present application and incorporated herein by reference.
[0037] PIF 110 has high throughput even at modest clock rates. Thus, in some embodiments, PIF 110 can perform IP routing for four 100 MB/sec Ethernet ports and respective four 155 MB/sec ATM ports at a clock rate of only 5 MHz.
[0038] In FIG. 1, the data flow between each slicer 140.x and the corresponding MAC 130.x is controlled by a corresponding channel 150.x (also called channel “x” below, i.e. channel 0, 1, 2 or 3). The channels 150 executes commands from microcontroller 160. In some embodiments, the four channels 150.x are implemented by a single channel circuit that performs the function of the four channels 150 using time division multiplexing. See the aforementioned U.S. patent application Ser. No. 09/055,044. “SYSTEMS AND METHODS FOR DATA TRANSFORMATION AND TRANSFER IN NETWORKS” incorporated herein by reference.
[0039] The channels, the microcontroller, the slicers 140 and the MACs 130 communicate through memory 164 which includes internal memory (“frame and command memory”) 170 and FIFOs 230, 240 described below.
[0040] In some Ethernet embodiments, the microcontroller is connected to MII (media independent interface) management circuit 180 connected to the Ethernet physical layer devices known in the art.
[0041] Search machine (SM) 190 maintains an address resolution database in memory 200 to do IP routing or other processing as determined by the software. SM 190 also maintains databases in memory 200 that restrict the network connectivity (e.g. by defining VLANs or access control lists). The search machine is able to search for a key (e.g. an Ethernet or IP address) presented to it by the microcontroller 160, and execute a learning algorithm to learn a layer-2 or layer-3 address if the address is not in the database. While search machine 190 is not software programmable in some embodiments, the search machine supports flexible database node structure allowing the search machine to be easily adapted to different functions (e.g. IP routing, layer-2 switching). Search machine 190 executes commands from the microcontroller, such as Search, Insert, Delete, etc. The search machine also provides the microcontroller with direct access to memory 200. The search machine is described in Addendum 8.
[0042] In some embodiments, memory 200 is implemented using synchronous static RAMs in flow through mode of operation. Multiple banks of memory are used in some embodiments.
[0043] In some embodiments, PIF 110 is an integrated circuit. Memory 200 is called “external” because it is not part of the integrated circuit. However, in other embodiments, memory 200 is part of the same integrated circuit. The invention is not limited by any particular integration strategy.
[0044] PIF 110 is also connected to a serial read only memory (ROM) 204 (serial EPROM in some embodiments) to allow the software (“firmware”) to be loaded from ROM 204 into the microcontroller at boot time.
[0045] FIG. 2 illustrates a single channel 150.x and associated FIFO resources in memory 164. The channel is divided into two similar parts: ingress sub-channel 150I that controls the data flow from the corresponding MAC 130 to the corresponding slicer 140; and egress sub-channel 150E that controls the data flow from slicer 140 to MAC 130. In reference numerals, suffix “I” indicates circuits belonging to the ingress sub-channel, and suffix “E” indicates circuits belonging to the egress sub-channel, unless noted otherwise.
[0046] In each sub-channel 150I, 150E the data processing includes the following steps:
[0047] (1) The corresponding input control block 210 (i.e. 210I or 210E) stores the incoming data in the corresponding data FIFO 220. When a sufficient portion of a data frame has been received to enable the microcontroller to start address translation or other processing (e.g., when the IP address and hop count have been received in IP routing embodiments), input control 210 writes a request to respective request FIFO 230. The number of frame bytes received before the request is written to FIFO 230 is defined by microcontroller-writable registers as described in the aforementioned U.S. patent application Ser. No. 09/055,044.
[0048] (2) Microcontroller 160 reads the request, reads appropriate parameters (for example, the source and destination addresses on the ingress side or the VPI/VCI on the egress side) from the corresponding data FIFO 220, and performs appropriate processing. The microcontroller uses the search machine 190 as needed to perform, for example, address resolution searches.
[0049] (3) When the search machine 190 has returned the search results to microcontroller 160, the microcontroller writes one of more channel commands to respective command FIFO 260 which specifies how the frame is to be transferred to the output device (MAC 130 or slicer 140).
[0050] (4) After the entire frame was received, the input control 210 writes status information to respective status FIFO 240. The status FIFO is read by microcontroller 160. If the status shows that the frame is bad (for example, the checksum is bad), the microcontroller writes to command FIFO 260 a “discard” command to cause the output control 250 to discard the frame.
[0051] Steps (2), (3) and (4) may involve other processing described below in connection with FIGS. 3A, 3B.
[0052] (5) Output control 250 executes commands from respective command FIFO 260.
[0053] In some embodiments, data FIFOs 220 and command FIFOs 260 are stored in internal memory 170. Request FIFOs 230 and status FIFOs 240 are stored in memory 230, 240 (FIG. 1).
[0054] The outputs of egress output control blocks 250E are connected to the microcontroller to enable the ATM switch 120 to load programs (“applets”) into the microcontroller for execution. The applets are first transferred to the egress side similarly to other frames, but their VPI/VCI parameters indicate the microcontroller. Hence, the applets are not transferred to MACs 130. Instead, the applets are loaded from the output of circuits 250E to the microcontroller program memory 314 (FIG. 5) by a DMA transfer.
[0055] Microcontroller 160 can also generate its own frames, write them to any data FIFO 220, and write commands to the corresponding command FIFO 260. The corresponding output control 250 will transfer the frames as specified by the commands.
[0056] The microcontroller can also write command FIFOs 260 with commands to transfer statistics information stored in a separate memory (not shown) for each sub-channel 150I, 150E.
[0057] In some embodiments, microcontroller 160 is an expensive resource. Of note, in some embodiments the microcontroller instruction execution unit (shown at 310 in FIG. 5 and described below) accounts for about 70% of the gate count of PIF 110. Therefore, it is desirable to fully load the microcontroller. Full loading is achieved by appropriate multi-tasking as follows.
[0058] The microcontroller executes four “hardware tasks” HT0, HT1, HT2, HT3, one for each port 0, 1, 2, 3. The hardware tasks are executed in time division multiplexing manner as shown in the following table:
[0059] If a hardware task is not available (because, for example, it is waiting for the search machine), no microcontroller instruction is started in the respective clock cycle.
[0060] Each hardware task includes one or more software tasks. Each software task contains code that processes an entire frame. Since a frame on the ingress side and a frame on the egress side can arrive in parallel, in some embodiments each hardware task includes at least two software tasks to allow parallel processing of at least two frames. In some embodiments, different software tasks are provided for the ingress and egress sides. When an ingress software task cannot execute due, for example, to the microcontroller waiting for the search machine, the microcontroller can execute the egress software task, and vice versa.
[0061] Below, the term “task” means a software task unless we specifically recite a “hardware task”.
[0062] FIG. 3A illustrates layer-3 processing of a single frame by an ingress task. At stage 290DA, the microcontroller reads from the frame the Ethernet (MAC) destination address DA at sub-stage 290DA.1. The microcontroller supplies the address to search machine 190, which performs the search at sub-stage 290DA.2.
[0063] At sub-stage 290DA.3, the microcontroller examines the search results. If the DA was not found, the frame will be dropped or broadcast. If the DA was found and the search machine recognized the DA as an address of a final destination station, the search results will include the VPI/VCI of the virtual connection (VC) on which the frame is to be transmitted to the final destination. In that case, the IP stage 290IP will be skipped. If the search results indicate that the DA is an address assigned to an IP routing entity, IP processing is performed at stage 290IP.
[0064] At that stage, the microcontroller reads the IP destination address from the frame at sub-stage 290IP.1. The search machine performs a search on that address at stage 290IP.2. The microcontroller examines the search results at sub-stage 290IP.3. The results include the VPI/VCI and, possibly, access control restrictions. At sub-stage 290IP.3, the microcontroller matches the access control restrictions with the IP source address to determine if the frame is allowed. If not, the frame will be dropped.
[0065] At stage 290SA, the Ethernet source address SA is processed to implement an address learning algorithm and also to implement VLANs. More particularly, at sub-stage 290SA.1, the search machine performs a search on the SA. The search machine inserts or amends the SA data if required by the learning algorithm. At sub-stage 290SA.2, the search machine returns the VLAN to which the SA belongs. At sub-stage 290SA.3, the microcontroller compares that VLAN with the DA VLAN returned by the search machine at stage 290DA.2. If the Ethernet source and destination addresses belong to different VLANs, the frame is dropped.
[0066] At one or more of sub-stages 290DA.3, 290IP.3, 290SA.3, the microcontroller writes commands to the command FIFO 260I for the respective data flow (i.e. respective sub-channel). The commands may instruct the channel 150 to drop the frame, or to forward the frame to respective slicer 140. If the frame is forwarded, the channel may supply the VPI/VCI to the slicer and, possibly, increment the IP hop count and/or replace the source address with the address of respective MAC 130, as directed by the commands.
[0067] FIG. 3B illustrates processing performed by an egress task for a single frame. At stage 294VC, the task examines the VPI/VCI to determine if the frame is an applet. If so, the task loads the frame into the microcontroller program memory (shown at 314 in FIG. 5 described below) and executes the applet. Stage 294IP is skipped.
[0068] Alternatively, the VPI/VCI may indicate that the frame is an information request from ATM switch 120. Examples of such requests include a request to read a register in PIF 110, or to read statistics information. The egress task performs the request. If this is a request for information, the egress task writes one or more commands to ingress command FIFO 260I of the same hardware task that executes the egress task. These commands will cause the channel to send the information to the switch. Stage 294IP is skipped.
[0069] If the VPI/VCI does not indicate any management request (such as a request for information) from switch 120, stage 294IP is performed. At sub-stage 294IP.1, the task (i.e., the microcontroller) reads the IP destination address from the frame and supplies the address to the search machine. At stage 294IP.2, the search machine performs the search and returns the Ethernet destination address and, possibly, access control information. At stage 294IP.3, the task writes commands to its egress command FIFO 260E to replace the Ethernet destination address of the frame with the address provided by the search machine, to replace the Ethernet source address with the address of the respective MAC 130.x, and to transfer the frame to the MAC. Other kinds of processing may also be performed depending on the task software.
[0070] While the microcontroller waits for the search machine at stages 290DA.2, 290IP.2, 290ISA.2, 294IP.2, the microcontroller is available to execute another software task in the same or other hardware tasks.
[0071] In some embodiments, having a single task for each ingress flow and each egress flow does not fully load the microcontroller, and therefore more than one task for each half-duplex data flow are provided to enable the microcontroller to process more than one frame in each data flow in parallel. This is illustrated by the following considerations. The demands on the microcontroller speed are the greatest when the Ethernet frames are short, because the same processing of FIGS. 3A, 3B has to be performed both for short and long frames. The shortest Ethernet frame has 64 bytes. Suppose for example that the four Ethernet ports are 100 MB/sec ports and the ATM ports are 155 MB/sec. At 100 MB/sec, the shortest frame goes through the Ethernet port in 5.12 microseconds. Therefore, the microcontroller and the search machine have to process the frame in 5.12+1.6=6.72 microseconds (1.6 microseconds is the interframe gap).
[0072] Let us assume a microcontroller clock speed of 50 MHz. This is a fairly slow clock speed to ensure reliable operation. Higher speeds (for example, 100 MHz) are used in other embodiments. At 50 MHz, the 6.72 microseconds is 336 clock cycles. Therefore, the clock cycle budget for the ingress and egress tasks of a single hardware task is 336/4=84 clock cycles.
[0073] Since processing of a frame is divided between the microcontroller and the search machine, which do not necessarily work in parallel on the same frame, the processing latency for one ingress frame and one egress frame in the same hardware task is allowed to be greater than 84 cycles even in wire speed processing. If processing takes more than 84 cycles, and 64-byte frames arrive back to back on the ingress and egress sides, the next frame may start arriving before the previous frame in the same data flow has been processed. Therefore, it is desirable to allow the microcontroller to start processing the next frame before the processing of the previous frame in the same data flow is completed. To implement such parallel processing of multiple frames in the same data flow, more than one software task for each data flow is provided.
[0074] Thus, in some embodiments, each hardware task HTx includes two ingress tasks IGx.0, IGx.1 and two egress tasks EGx.0, EGx.1. For example, hardware task HT1 includes ingress tasks IG1.0, IG1.1 and egress tasks EG1.0, EG1.1. Each task is identified by a 4-bit task number including:
[0075] CHID—channel ID (2-bits)=0, 1, 2 or 3 for respective ports 0, 1, 2, 3;
[0076] SN—sequence number (0 for IGx.0, EGx.0; 1 for IGx.1, EGx.1);
[0077] I/E—0 for ingress; 1 for egress.
[0078] The total number of tasks is thus 16.
[0079] A frame is processed by a single task. If the frame is an applet, the applet is executed by the same task.
[0080] The microcontroller instruction execution is pipelined. Thus, Table 1 above indicates clock cycles in which a new instruction is started for the respective hardware task. For example, in cycle 1, instruction execution is started for hardware task HT0. The instruction execution continues in subsequent cycles.
[0081] Task access to FIFOs 230, 240, 260 in each sub-channel is controlled as shown in the logic diagram of FIG. 4. In FIG. 4, “Task 0” and “Task 1” are the two tasks for the same sub-channel, for example, ingress tasks IG1.0, IG1.1 for sub-channel 150I of channel 150.1. At the beginning, only Task 0 has access to the sub-channel FIFOs 230, 240, 260. When Task 0 accesses the request FIFO 230, switch “a” is flipped to connect the request FIFO to Task 1. Task 0 will not be allowed to read the request FIFO again until Task 1 has read the request FIFO.
[0082] Switch “b” controls the task access to command FIFO 260. Switch “b” is flipped when all the commands for a frame have been written by Task 0.
[0083] Switch “c” which controls the task access to status FIFO 240 is flipped when the status FIFO has been read by Task 0.
[0084] To synchronize task access to the search machine, search machine 190 executes commands one after another providing results in the same order.
[0085] Selecting a task for execution takes only one clock cycle (pipeline stage TS in FIG. 6 described below) in each instruction. Further, the task selection is pipelined, and hence does not affect the throughput. The task selection is performed by hardware. No operating system is used in the microcontroller. Therefore, low latency is achieved.
[0086] At any time, each task is in one of the three states, Active, Ready, or Suspended. In the Active state, the task is being executed. At most four tasks (one for each hardware task) may be Active at the same time. Each Active task is scheduled for execution once every four clock cycles (see Table 1 above).
[0087] An Active task is transferred to the Suspended state if the task tries to access a resource that is unavailable. The resources are described in Addendum 2. When the resource becomes available, the task goes to the Ready state.
[0088] When an Active task is suspended, one of the tasks in the Ready state in the same channel is selected for execution by task control 320 (FIG. 5) and is transferred to the Active state.
[0089] FIG. 5 is a block diagram of microcontroller 160. Execution unit 310 executes programs stored in program memory 314. Programs are downloaded from ROM 204 (FIG. 1) during boot. In addition, applets can be loaded and executed dynamically as described above. The applets can be discarded after being executed, or they can remain in memory 314.
[0090] Execution unit 310 includes a register file 312 having general purpose registers, a special registers block 315, and a data memory 316. Register file 312 includes two 32-bit outputs connected to respective buses sa_bus, sb_bus, which in turn are connected to inputs of ALU 318. 32-bit outputs of data memory 316 and special registers block 315 are connected to sa_bus. Separately connected to bus sa_bus are the outputs of special registers “null” and “one” (Table A6-1, Addendum 6) that store constant values (these registers are marked “Constant regs” in FIG. 5).
[0091] Bus sa_bus also receives the immediate field “imm” of an instruction read from program memory 314.
[0092] The 64-bit output of ALU 318 is connected 64-bit bus res_bus which is connected to inputs of register file 312, data memory 316, and special registers block 315.
[0093] Register file 312, data memory 316 and special registers 315 are described in Addendum 6. As described therein, the registers and the data memory are divided between tasks so that no save/restore operation is needed when tasks are rescheduled. In particular, special registers 315 include 16 PC (program counter) registers, one for each task.
[0094] Load/store unit (LSU) 330 provides an interface between execution unit 310, search machine 190, and internal memory 170. LSU 330 queues load and store requests to load a register from memory or to store register contents in memory. LSU 330 has an input connected to res_bus and also has a 64-bit output rfi connected to an input of register file 312.
[0095] DMA block 340 has an input connected to the bus res_bus to allow execution unit 310 to program DMA 340. DMA 340 can load applets into the program memory.
[0096] FIG. 6 illustrates the instruction execution pipeline. The pipeline has seven stages:
[0097] (1) Task Select (TS) stage t0. In this stage, an active task is selected for the respective channel 150.x by task control 320. In some embodiments, the task control block implements a fixed priority scheme: task IGx.0 has the highest priority, then IGx.1, then EGx.0, and then EGx.1.
[0098] In some embodiments, once a task is made active, it is not suspended simply because a higher priority task becomes ready to run. The lower priority task remains active until it tries to access an unavailable resource.
[0099] (2) During the Fetch (F) stage t1, task control block 320 drives the active task number signal task#_t1 (same as tsk_taskNumt1 in Table A1-1, Addendum 1) to execution unit 310. Signal task#_t1 selects one of the 16 PC values in special registers 315.
[0100] If no task is active, task control block 320 asserts the “idle” signal to execution unit 310. The signal is shown as “tsk_idle” in Table A1-1. When “idle” is asserted, task#_t1 is “don't care”, and instruction execution unit 310 executes a NOP (no operation) instruction in the remaining pipeline stages.
[0101] If “idle” is deasserted, the PC register value selected by task#_t1 in special registers block 315 is provided to program memory 314. The instruction pointed to by the selected PC is read out from the memory to execution unit 310.
[0102] (3) During the Decode (D) stage t2, the instruction is decoded by the execution unit.
[0103] (4) During the Read (R) stage t3, the instruction operands are read from register file 312 and/or special registers 315 and/or data memory 316 and presented to ALU 318.
[0104] Also at this stage, task control 320 generates the Suspend signal (tsk_susp in Table A1-1) on lead 410 (FIG. 5) as described in more detail below in connection with FIGS. 7-13B. If the Suspend signal is asserted, the task is suspended, the instruction execution is aborted and the task's PC register is frozen. When a task is made Active later, the same instruction will be re-executed.
[0105] Also at this stage, execution unit 310 generates a Wait signal. If the Wait signal is asserted, the instruction execution is not completed and the PC register is frozen, but the task remains active, and the instruction will be executed again starting the next clock cycle. For example, if instruction 1 in FIG. 6 is delayed due to the Wait signal being asserted in cycle 3, the same instruction will be re-executed as instruction no. 5 starting in cycle 4.
[0106] The Wait signal is asserted when a condition blocking the instruction is likely to disappear by the time the same hardware task is scheduled again. The Wait conditions are described in Addendum 3.
[0107] If the Suspend and Wait signals are deasserted, the PC register is changed to point to the next instruction.
[0108] (5) During the Execution (E) stage t4, the instruction is executed.
[0109] (6) During the Write Back (WB) stage t5, the results of the execution stage are written to their destinations except if a destination is in register file 312.
[0110] (7) During the Write Registers (WR) stage, the results of the execution stage are written into the register file 312 if required.
[0111] Of note, the WR stage of each instruction (e.g. instruction 1, cycle 6) occurs before the R stage of the next instruction of the same hardware task (see instruction 5, cycle 7). Therefore, if, for example, instruction 5 uses the results of instruction 1, the results will be written to the register file or the special registers before the instruction 5 reads them in cycle 7.
[0112] As illustrated in FIG. 6, when an instruction is aborted (at the R stage), the pipeline does not have to be purged from other instructions that have already been started, because these instructions belong to other tasks (moreover, to other hardware tasks). For example, if instruction 1 has to be aborted, the only other instructions that have been started on or before the R stage of instruction 1 are instructions 2, 3 and 4. These instructions do not have to be purged because they are executed by other tasks.
[0113] For a given hardware task, switching between the corresponding four software tasks does not require execution of separate instructions as would be the case if task switching were performed by operating system software. High throughput is therefore achieved.
[0114] FIG. 7 is a bubble diagram illustration of task synchronization with respect to a single request FIFO 230 or status FIFO 240. In the bottom diagram 704, “Task 0” and “Task 1” have the same meaning as in FIG. 4. More particularly, these are the two software tasks sharing the request or status FIFO. In some embodiments, Task 0 is IGi.0 for the ingress sub-channel, or EGi.0 for the egress sub-channel.
[0115] Diagram 704 is a state machine illustrating the FIFO ownership. On RESET, the FIFO is owned by Task 0, as indicated by state 710RS.0.
[0116] When Task 0 has successfully read the FIFO, the FIFO becomes owned by Task 1, as indicated by state 710RS.1. Reading the FIFO is equivalent to flipping the “a” or “c” switch of FIG. 4. When Task 1 has successfully read the FIFO, the state machine returns to state 710RS.0.
[0117] The FIFO reading operation is indicated by condition mfsel[x] & ffrd. The signal mfsel is described in Addendum 4. The signal ffrd is asserted by the execution unit in stage t3 when any request or status FIFO is read by the microcontroller. A separate ffrd version is generated for each request and status FIFO. (If the FIFO read is successful, signal mfrd of Addendum 4 is asserted in stage t5.)
[0118] There are 16 request and status FIFOs. Each of these FIFOs is identified by a unique number “x” from 0 to 15. When the FIFO “x” is being read, the number “x” is driven on lines mfsel, as indicated by mfsel[x] in FIG. 7.
[0119] Diagrams 720 and 740 indicate how Tasks 0 and 1 change states with respect to the FIFO. As indicated above, each task has three states: Ready (“RDY”), Active and Suspended. On RESET, all the tasks become Ready. A task becomes Active if selected at pipeline stage t0.
[0120] In the embodiment being described, a task cannot go from the Active state to the Ready state directly, though this is possible in other embodiments.
[0121] In the embodiment being described, each task goes from the Active state to the Suspend state on a “Suspend” condition 730. A suspended task becomes Ready on a release condition 734. The possible suspend conditions are listed in Table A1-2 of Addendum 1. The release conditions are listed in Table A1-3.
[0122] In diagram 720, the suspend condition 730 occurs when Task 0 attempts to access the FIFO when the FIFO is not available. More particularly, the condition 730 is:
[0123] (1) the task is in pipeline stage t3 (indicated by signal “T3” generated by execution unit 310);
[0124] (2) ffrd is asserted indicating a FIFO read operation;
[0125] (3) mfsel identifies the FIFO “x”; and
[0126] (4) either the FIFO is owned by Task 1 (state machine 704 is in state 710RS.1), or signal cfifordy[x] is low indicating that the FIFO “x” is empty. (Signal cfifordy is described in Addendum 4. This signal is sampled every fourth cycle and is valid when sampled.)
[0127] The fact that the FIFO is being read by Task 0 and not by any other task is established by Task 0 being in pipeline stage t3.
[0128] Condition 730 for Task 1 (diagram 740) is similar.
[0129] Conditions 730 in diagrams 720, 740 are shown in Table A1-2 (Addendum 1) separately for each type of task (ingress task 0, ingress task 1, egress task 0, egress task 1) and each type of FIFO (request and status). The request FIFO conditions are listed as conditions number 1 in each of the four sections “Ingress Task 0”, “Ingress Task 1”, “Egress Task 0”, “Egress Task 1”. Thus, for ingress task 0, the condition is:
[0130] exe_RfifoRd & mfsel[x] & (Ireqf|˜cfifordy[x])
[0131] Signal exe_RfifoRd is the same as ffrd. Ireqf indicates that the FIFO is owned by Ingress Task 1. All the signals in Table A1-2 are sampled in stage t3, so “t3” is omitted from some of the conditions in the table. For egress task 0, signal Ereqf indicates the respective request FIFO is owned by egress tasks 1. Thus, Ereqf replaces Ireqf. Task control 320 generates a separate signal Ireqf or Ereqf for each request FIFO.
[0132] In Addendum 1, the signal negation is indicated by “˜” before the signal name (as in ˜cfifordy) or by the underscore following the signal name (as in Ereqf_ in condition 1 for egress task 1).
[0133] For the status FIFOs, the suspend conditions 730 are conditions numbered 2 in table A1-2. Signal exe_SfifoRd is the ffrd version for a status FIFO. The number identifying the status FIFO is shown as “y” rather than “x ”.
[0134] Release condition 734 in diagram 720 is: Task 0 owns the FIFO (state machine 704 is in state 710RS.0), and cfifordy[x] is high indicating that the FIFO is not empty. The release condition 734 for task 1 (diagram 740) is similar.
[0135] The release conditions are shown in Table A1-3 in Addendum 1. Each release condition corresponds to the suspend condition in the same slot in Table A1-2. For example, release condition 1 in section “Ingress Task 0” in Table A1-3 releases the task to the Ready state if the task was suspended by suspend condition 1 in section “Ingress Task 0” in Table A1-2. Thus, release conditions 1 and 2 in Table A1-3 correspond to the release conditions 734 in diagram 720 and 740 for the request and status FIFOs.
[0136] FIG. 8 illustrates task synchronization in an ingress sub-channel with respect to the sub-channel command FIFO 260 (i.e. 260I). Bottom diagram 804 illustrates the state machine for the ingress command FIFO. The FIFO can be owned both by the ingress and the egress tasks. On RESET, the state machine is in a state S0. In this state, the FIFO is owned by Ingress Task 0. When Ingress Task 0 writes to the FIFO a single word without locking the FIFO (flipping the switch “b” in FIG. 4), the FIFO moves to state S1 in which the FIFO is owned by Ingress Task 1. The writing operation is indicated by signal IcmdFifoWr[x], where “x” identifies one of the four ingress and egress tasks that can write the ingress command FIFO. (If IcmdFifoWr[x] is asserted by the execution unit in stage t3, the corresponding mfload bit (Addendum 4) is asserted in stage t5.) Signal IcmdFifoWr[x] is asserted for an appropriate “x” whenever a respective task writes the FIFO.
[0137] The absence of locking is indicated by the “unlock” signal generated by execution unit 310 from the L flag of microcontroller instruction “CMD” (Addendum 7) used to write the command FIFOs.
[0138] When Ingress Task 1 writes a command FIFO (as indicated by IcmdFifoWr[x] where “x” indicates ingress Task 1) without locking the FIFO the state machine returns to state S0.
[0139] When Ingress Task 0 writes the FIFO in state S0 and the “lock” signal is asserted indicating that the FIFO is to be locked, the state machine moves to state S2. In that state, the FIFO is still owned by Ingress Task 0. The lock signal is generated by execution unit 310 from the L flag in microcontroller instruction CMD (Addendum 7). The FIFO remains in state S2 until Ingress Task 0 writes the FIFO with the “unlock” signal asserted. At that time, the FIFO moves to state S1.
[0140] Similarly, if Ingress Task 1 writes the FIFO in state S1 with “lock” asserted, the FIFO moves to state S3. In that state the FIFO is still owned by Ingress Task 1. The FIFO remains in state S3 until Ingress Task 1 writes the FIFO with “unlock” asserted. At that time, the FIFO moves to state S0.
[0141] When the state machine is in state S0 or S1, and an egress task writes the command FIFO without locking the FIFO, no state transition occurs. When egress task 0 writes the FIFO with locking in state S0, the FIFO moves to state S4. In that state, the command FIFO is owned by Egress Task 0. The state machine remains in state S4 until Egress Task 0 writes the command FIFO with “unlock” asserted. At that point, the state machine returns to state S0.
[0142] State S5 is similar to S4, but describes Egress Task 1 writing and owning the command FIFO.
[0143] States S6 and S7 are similar to respective states S4 and S5, but states S6 and S7 are entered from state S1 rather than S0.
[0144] Diagrams 820 and 840 illustrate state transitions of respective Ingress Tasks 0 and 1 with respect to the command FIFO. The suspend conditions 730 are conditions number 3 in Table A1-2. Signal IcmdFifowr[x] is the same as exe_IcmdFifoWr [x] in conditions 3 for ingress tasks 0 and 1. Signal task#_t3 in Table A1-2 is the same as “T3” in diagrams 820 and 840. Signal ccmdfull[x] is a signal that the command FIFO “x” is full (see Addendum 4). This signal is valid in stage t3. Signal IcmdfOwnedByI0 indicates that the command FIFO is owned by ingress task 0 (that is, state machine 804 is in state S0 or S2). Signal IcmdfOwnedByI1 indicates that the command FIFO is owned by ingress task 1 (states S1, S3 in diagram 804).
[0145] For the egress tasks, the suspend conditions caused by writing to the ingress command FIFOs are conditions 8 in Table A1-2. Signal IcmdfOwnedByE0 indicates that the command FIFO is owned by egress task 0 (states S4, S6 in diagram 804). Signal IcmdfOwnedByE1 indicates that the command FIFO is owned by egress task 1 (states S5, S3 in diagram 804).
[0146] The release conditions 734 (FIG. 8) are conditions 3 for the ingress tasks in Table A1-3.
[0147] The egress task synchronization with respect to the egress command FIFOs is similar. For the egress FIFOs, states S4, S5, S6, S7 are absent. In Tables A1-2 and A1-3, the pertinent conditions are conditions number 3. Signal exe_EcmdFifoWr replaces exe_IcmdFifoWr to indicate a write operation to the egress FIFO. Signal Ecmdf1 indicates that the FIFO is owned by egress task 1.
[0148] FIG. 9 illustrates egress task synchronization with respect to the DMA resource. The bottom diagram 904 illustrates the DMA state machine. On RESET, the DMA is IDLE. When an egress task writes a DMA address (DMA transfer destination address in program memory 314) to the DMA address register DMAA (Addendum 6) of DMA 340 (FIG. 5), as indicated by “dmaa_wr” in FIG. 9, the task becomes the DMA owner, and the DMA 340 becomes active and starts the DMA transfer from internal memory 170. In the example of FIG. 9, the DMA owner is an Egress Task 0.
[0149] When the transfer has been completed, as indicated by “last_word” in FIG. 9, the DMA becomes ready (“RDY”).
[0150] When the DMA is in the Ready state, and the DMA owner task reads the DMA address register (indicated by “dmaa_rd” in FIG. 9), the DMA moves to the Execute state. The DMA owner is allowed to read the address register only in the DMA Ready state. Non-owner tasks are allowed to read the DMA address register in any DMA state.
[0151] When the DMA is in the Execute state, the DMA owner task executes the applet loaded by the DMA. No new DMA access is allowed.
[0152] When the DMA owner task writes the release code 111 into the OP field of the DMAA register (Addendum 1), the DMA returns to the Idle state.
[0153] Diagrams 920, 930 illustrate state transitions for two egress tasks Task 0, Task N, not necessarily in the same hardware task. The conditions 730 are conditions 7 for the egress tasks in Table A1-2. In the table, exe_dmaaRd is the same as dmaa_rd in FIG. 9; exe_dmaaWr is the same as dmaa_wr. “dmaa_rd,wr” in FIG. 9 means “dmaa_rd OR dmaa_wr”. Signals exe_dmaaRd, exe_dmaaWr are generated by execution unit 310.
[0154] Thus, the DMA owner task is suspended when it attempts either to read or write the DMA address register in stage t3 while the DMA is Active. The owner task is released when the DMA becomes Ready. The non-owner task is suspended when it attempts to write the DMA register in stage t3 while the DMA is Ready. The non-owner task is released when the DMA becomes Idle.
[0155] The release conditions 734 are indicated as “clast_word” in conditions 7 for egress tasks 0 and 1 in Table A1-2.
[0156] FIG. 10 illustrates task synchronization with respect to a semaphore register semr (Appendices 2, 6). The suspend conditions 730 are shown as conditions 5 in Table A1-2. Each suspend condition is as follows: (1) the task is in pipeline stage t3, and (2) a BITC or BITCI instruction is executed by the task with the target operand being the semaphore register, and the instruction has to be aborted because it is trying to write the same value to the semaphore register bit as the value the bit has had since before the instruction (this is indicated by signal exe_bitcSemReg in Table A1-2; all the signal names starting with “exe_” denote signals generated by execution unit 310). When the suspend occurs, task control block 320 sets a flag SPx to 1 where “x” is the task number (0-15).
[0157] The release condition 730 is that the flag SPx is cleared (i.e. set to 0). The task control block 320 clears all the flags SPx when any one of the following two conditions occurs:
[0158] (1) in pipeline stage t3, an instruction BITC or BITCI is executed successfully by some other Task Y. This condition is indicated by signal exe_bitcSemAcc in release conditions 5 in Table A1-3.
[0159] (2) The channel 150 writes the semaphore register. This is indicated by cstrobe being asserted (Table A4-1 in Addendum 4) and csem[5] being at 1. The channel accesses the semaphore register to send an indication to microcontroller 160 when commanded by a channel command. See the aforementioned U.S. patent application Ser. No. 09/055,044 “Systems and Methods for Data Transformation and Transfer in Networks” incorporated herein by reference.
[0160] FIG. 11 illustrates task state transitions with respect to the search machine 190. Suspend condition 730 (conditions 4 in Table A1-2) is that both of the following conditions (1) and (2) are true:
[0161] (1) the task is in pipeline stage T3, the task is executing an instruction writing a command to the search machine (signal scmd_wr, shown as exe_scmdWr in Table A1-2 ) or reading a result from the search machine (signal sres_rd, shown as exe_scmdRd in Table A1-2). See microcontroller instruction SMWR (search machine command write) in Addendum 7 and the description of registers scmd, scmde in Addendum 6.
[0162] (2) the search machine resources are not available to the task, as indicated by the signal task_ownbit[x] being 0 (“x” is the task number). This signal is shown as sm_task_ownbit in Tables A1-1 and A1-2 in Addendum 1. The signals whose names start with “sm_” are generated by search machine 190. The search machine resources and suspend conditions are described in Addendum 2.
[0163] The release condition 734 is: the respective task_ownbit[x] is 1.
[0164] FIG. 12 illustrates task synchronization with respect to the free list of scratch buffers 1610 (FIG. 16 and Addendum 5) in memory 170. The suspend condition 730 (conditions 6 in Table A1-2) is that all of the following are true:
[0165] (1) The task is in pipeline stage t3 ;
[0166] (2) The task is reading the internal free list register IFREEL (Addendum 6), as indicated by signal ifreel_rd generated by the execution unit. This signal is shown as exu_ifreelRd in Table A1-2. The IFREEL register is read to get a free buffer number.
[0167] (3) The “no_free_buffers” (“no_free_buf”) signal is asserted by the special registers block 315 to indicate no free buffers.
[0168] The release condition 734 is that either of the following three conditions becomes true:
[0169] (1) cstrobe (Table A4-1 in Addendum 4) is asserted by channel 150 while and csem [5 ] is 0, indicating that the channel 150 is returning the scratch buffer 1610 identified by signals csem[4:0] to the internal free list;
[0170] (2) signal IfreelWr (exu_ifreelWr in Table A1-3) is asserted by the execution unit, indicating that the microcontroller is writing to the IFREEL register (Addendum 6); this register is written with a number of a scratch buffer being freed;
[0171] (3) signal IfreerWr (exu_ifreerWr) is asserted by the execution unit, indicating that the microcontroller is writing to the IFREER register.
[0172] FIG. 13A is a block diagram of task control block 320. Task control 320 includes four identical blocks of latches 1304.0, 1304.1, 1304.2, 1304.3. Latches 1304.0 store the information related to a hardware task in pipeline stage t0 (TS). That information is provided to the inputs of latches 1304.1. Latches 1304.1 store information on the hardware task in pipeline stage t1. Similarly, latches 1304.2, 1304.3 store information on hardware tasks in respective stages t2, t3. The outputs of latches 1304.1 are connected to respective inputs of latches 1304.2. The outputs of latches 1304.2 are connected to respective inputs of latches 1304.3. The outputs of latches 1304.3 are used to determine whether the software task in pipeline stage t3 should be suspended, and are also used to determine the states of the software tasks for the respective hardware tasks, as described below.
[0173] All the latches are clocked by the same clock (not shown).
[0174] In each block 1304, latch 1320 stores the respective hardware task number HT# (same as CHID above). Latch 1322 stores the active software task number ST#=<SN, I/E> for the hardware task. If no task is active for the hardware task, the output of latch 1322 is “don't care. ”
[0175] Thus, the outputs of latches 1320, 1322 of block 1304.1 form the signal task#_t1 (FIG. 5), and the outputs of latches 1320, 1322 of block 1304.2 form the signal task#_t2. The outputs of latches 1320, 1322 of block 1304.3 are connected to the inputs of latch circuit 1360, whose output is connected to the input of latch circuit 1362. The output of circuit 1362 provides the signal task#_t5 (FIG. 5).
[0176] The output of latch 1320 of block 1304.3 is connected to the input of latch 1320 of block 1304.0.
[0177] Each block 1304 contains four latch circuits 1330, one for each of the four software tasks IGx.0 (also shown as “I0” in FIG. 13A), IGx.1 (“I1”), EGx.0 (“E0”), and EGx.1 (“E1”), wherein “x” is the hardware task number stored in respective latch 1320. Each latch circuit 1330 includes two latches 1330S, 1330C, shown for simplicity only for task E1. Circuit 1330S stores the task's state (i.e., Ready, Active or Suspended). Circuit 1330C stores the release condition 734 needed to transfer the task to the ready state. The release condition is stored in the form of an index from 1 to 7 (as in Table A1-3), or from 0 to 6. The indices of possible release conditions for each type of task (I0, I1, E0, E1) are shown in the left column in Table A1-3 in Addendum 1.
[0178] The information in latch 1330C is meaningful only if the state stored in the respective latch 1330S is “Suspended”. For the ready and active states, the information in latch 1330C is “don't care”.
[0179] Each block 1304 includes six latches 1350 which store the states of the six respective request, status and command FIFOs for the corresponding hardware task. Possible states are illustrated in diagrams 704 (FIG. 7) and 804 (FIG. 8) and described above.
[0180] The outputs of latch circuits 1330, 1350 of block 1304.3 are connected to next state and condition generator 1354. Circuit 1354 generates the next states of tasks and request, status and command FIFOs and also next release condition values. These state and condition signals are provided via bus 1358 to the inputs of circuits 1330, 1350 of block 1304.0.
[0181] FIG. 13B shows the circuit 1354 in more detail. In circuit 1354, resource next stage generator 1380 receives the request, status and command FIFO states from latch circuit 1350 of block 1304.3. Generator 1380 also receives all the signals described above in connection with diagrams 704 and 804 which can cause state transition of any one of the resource, status and command FIFOs. Generator 1380 calculates the next states of the FIFOs in accordance with diagrams 704 and 804, and provides the next states to latch circuit 1350 of latch block 1304.0 in the same clock cycle t3.
[0182] The output of each latch circuit 1330 is connected to the input of respective circuit 1390. For simplicity, only the circuit 1390 for task E1 is illustrated in detail. For task E1, the release condition output of latch 1330C is connected to the select input of a multiplexer 1394. The data inputs of multiplexer 1394 receive the seven possible release conditions 734 for task E1 (Table A1-3 section “Egress Task 1”). Each data input to multiplexer 1394 is a one-bit signal asserted if the corresponding release condition is true, and deasserted if the condition is false.
[0183] The release condition signal selected by multiplexer 1394 (that is, the signal corresponding to the release condition stored in latch 1330C of block 1304.3) is provided to task next stage generator 1398. Generator 1398 also receives the task's current state from latch 1330S and the Suspend signal on lead 410 from suspend logic and release condition generator 1401 described below. Task next stage generator 1398 generates a signal A indicating whether the task remains suspended or, alternatively, whether the task can be made active in the same clock cycle. Signal A is generated according to the following table 2:
[0184] Arbiter 1403 receives the A outputs from the four circuits 1390 and generates from them the following signals on bus 1358: (1) the next stage of each task for respective latches 1330S of block 1304.0; and (2) the active software task number ST# on lead 1404. The software task number is delivered to latch 1322 of block 1304.0.
[0185] Arbiter 1403 also generates the signal “idle” which is asserted to indicate that no task is active (see also FIG. 5).
[0186] Each circuit 1390 for tasks I0, I1 , E0 includes the signal A generation logic identical to multiplexer 1394 and task next state generator 1398 for task E1, except that the release condition inputs to the multiplexers are taken from the sections of Table A1-3 which correspond to the respective tasks (Ingress Task 0, Ingress Task 1, or Egress Task 0).
[0187] Suspend logic and release condition generator 1401 receives the outputs of latch circuits 1350 of block 1304.3 and also receives all the signals (e.g. cfifordy, mfsel, etc.) needed to calculate the suspend conditions 730 (FIG. 7-12 and Table A1-2 of Addendum 1). Block 1401 calculates the suspend conditions for an active task identified by the output of latch 1322 of block 1304.3. Suspend logic 1401 provides the suspend signal on lead 410 to task next state generator 1398 and to similar generators in the other three circuits 1390.
[0188] In addition, suspend logic 1401 generates the release condition data inputs 734 for each multiplexer 1394 and similar multiplexers (not shown) in the other 3 blocks 1390. The release conditions are generated according to the formulas of Table A1-3.
[0189] Further, suspend logic 1401 receives the state outputs of all the state latches 1330S in block 1304.3. For each task, if: (1) the state output indicates the active state, and (2) one of the suspend conditions for the task is TRUE, suspend logic 1401 generates the index 734_in of the release condition needed to make the task ready. A separate index 734_in is generated for each task according to the respective section in Table A1-3. FIG. 13B shows the index 734_in for task E1 only.
[0190] In all the other cases (that is, if the state output for the task is not “active” or the state output is active but no suspend condition for the task is TRUE), the release index 734_in for the task is “don't care”.
[0191] The release index 734_in for task E1 is provided to a data input of multiplexer 1406. The other data input of the multiplexer receives the condition output from latch 1330C of block 1304.3 for task E1. The select input receives the “act” bit from state output of latch 1330S of block 1304.3 for task E1. The state output has two bits. The bit “act” is one of the two bits. The bit “act” indicates whether the state is “active”. If “act” indicates the active state, multiplexer 1406 selects the release index 734_in. If “act” indicates a non-active state, multiplexer 1406 selects the output of condition latch 1330C. The selected signal is provided to bus 1358 which supplies the signal to latch 1330C for task E1 in block 1304.0.
[0192] Similarly, each circuit 1390 for each task includes a similar multiplexer 1406 (not shown) which selects: (1) the release condition index 734_in for the respective task from suspend logic 1401 if the output “act” from the latch circuit 1330 of block 304.3 or the respective task indicates an active state, and (2) the condition output of latch 1330 of block 1304.3 or the respective task if “act” indicates a non-active state. The selected condition index is provided to the input of the respective latch 1330 in block 1304.0.
[0193] In some embodiments, when one task is suspended, the registers having task-specific values are not saved. In particular, each task has its own PC register having the task PC and flags (see Addendum 6). Further, register file 312 is divided into eight banks. Each bank is dedicated to a pair of an ingress task and an egress task from the same channel. The software executed by the task pair is written so that there are no common registers between the pair. Hence, while the register file registers may store task-specific values, these registers do not have to be saved or restored.
[0194] The embodiments described herein do not limit the invention. In particular, the invention is not limited by the number of ports, or by ports being full- or half-duplex, or by any timing, signals, commands or instructions. In some embodiments, the microcontroller comprises multiple execution units having the pipeline of FIG. 6 or some other pipeline. In some embodiments, one or more microcontrollers comprise multiple execution units such as present in a super scaler or VLIW (very large instruction word) processor. In some embodiments, the microcontroller is replaced by a processor implemented with multiple integrated circuits. The term “task” as used herein includes processes and threads. Other embodiments and variations are within the scope of the invention, as described by the appended claims.
ADDENDUM 2
RESOURCES
[0195] All resources are accessed through special registers or dedicated microcontroller commands.
[0196] Search Machine
[0197] The Search Machine has two resources: Command, written by the microcontroller, and Result.
[0198] There are 16 write only Command resources (one for every task). The only case when this resource is not available is when a previous command from the same task is not completed.
[0199] There are 16 read only Result resources (one for each task). When a command is posted to the Search Machine, the Result becomes unavailable until the command is executed. Some commands (e.g. Insert or Delete) do not have a result.
[0200] Channel Control
[0201] The channel control has three kinds of resources: command FIFOs 260, request FIFOs 230, and status FIFOs 240.
[0202] A command resource is unavailable in two cases:
[0203] a. The resource belongs to another task. In this case when the other task releases the resource, it becomes available to this task.
[0204] b. Command FIFO is full. In this case when the Command FIFO becomes not full, the task can continue to use this resource.
[0205] The Command resource has session protection (i.e. several commands can be written by one task before the resource is passed to another task). This is achieved by locking the resource during the first access and unlocking it in the last access. When the Command resource is locked, no other task can access this resource.
[0206] An egress task EGx of a channel 150.x may write commands to an ingress command FIFO 260I of the same channel 150.x to send a message to switch 120. The egress task may write the ingress command FIFO whenever the ingress command FIFO is unlocked. When the egress task writes its first command to the ingress command FIFO 260I, the command FIFO becomes locked until the last command from the egress task has been written.
[0207] A Request or Status FIFO resource is not available in two cases:
[0208] a. The resource belongs to another task. In this case when the other task reads the FIFO, the resource becomes available to this task.
[0209] b. The FIFO is empty. In this case when the FIFO becomes ready, the task can continue to use this resource.
[0210] DMA
[0211] The DMA block is responsible for downloading applets from data FIFOs to the program memory 314. This resource is used by egress tasks which set the DMA address before the transfer and read the last word address when the transfer is complete. Reading the last word address during the transfer will cause the task to be suspended until the last word is transferred. Also, an attempt to write a new DMA address by another egress task, when the first transfer is not complete, will cause the task suspension.
[0212] Internal Memory 170 Management
[0213] The Internal Memory Management is responsible for managing free buffers 1610 (FIG. 15) inside the Scratch Pad Area in the internal memory. There are 32 free buffers in the memory. When a task wants to get the next available free buffer, it accesses the Free List (FreeL) resource (register IFREEL in Addendum 6). If there are no buffers left, the task will be suspended. The buffers are released back to the free list when a channel command which used this buffer indicates that the buffer is to be released.
[0214] Semaphore
[0215] The semaphore register semr has 32 bits. Each of them is directly accessible using the Bit Change Immediate (BITCI) and BITC commands of the microcontroller. The semaphores are used for protection and communication between tasks.
[0216] If the BITCI or BITC command attempts to write the same value to the bit as the current bit value, it will be aborted and its task will be suspended. Later on, when the semaphore register is changed (any bit in the register is changed), all tasks which are waiting for a semaphore will be made Ready and will try to execute the Bit_Change_Immediate command again.
[0217] Bits 31-24 of the semaphore register can be set by changing respective predetermined external pins (not shown) of PIF 110 from 0 to 1.
ADDENDUM 3
TASKS WAIT CONDITIONS
[0218] There are two conditions which may cause the Wait signal to be asserted:
[0219] (1) Register Scoreboard
[0220] For each register in the microcontroller there is a scoreboard bit which indicates its status. If the bit is set, the register is dirty, i.e. waiting for data to be loaded by the LSU 330. A possible scenario is as follows:
[0221] (a) A task requests loading the register by the LSU.
[0222] (b) The task requests using this register as a source. However, the scoreboard is dirty. Hence, the Wait signal is asserted.
[0223] (c) Then the LSU loads the register.
[0224] (d) The task again requests using this register as a source. This time the usage is permitted.
[0225] (2) LSU FIFO Full
[0226] This is another condition to generate the wait signal. Once the LSU FIFO that queues the load and store requests becomes ready this condition is cleared.
ADDENDUM 4
[0227] The following table lists some signals used in the channel/microcontroller interface. “I” means the signal is an input for the channel. “O” means the signal is a channel output.
ADDENDUM 5
MEMORY
Map of Internal Memory
[0228] The internal memory map is shown in FIG. 14.
[0229] Data Area 1510 (Addresses 0000-1FFF HEX)
[0230] This area is used for the Scratch Pad 1610 and the Data and Command FIFOs. This area is accessed using relative addresses. The data area memory map is shown in FIG. 15.
[0231] In FIG. 15, “DBASE_I” is the “DBASE” field of the CFGR register (described below) for the ingress side. Similarly, DLEN, CBASE, CLEN are fields of the corresponding CFGR register. The suffix “_I” stands for ingress, and “_E” stands for egress.
[0232] Control Area 1520 for Each Channel
[0233] One of the register types in this area is:
[0234] CFGR—Channel Configuration Register (Ingress & Egress)
[0235] There are 8 CFGR registers, one per direction of each channel. Their fields are:
[0236] Data Area 1530 (Address 4000-5FFF HEX)
[0237] This area is described in the aforementioned U.S. patent application Ser. No. 09/055,044.
ADDENDUM 6
MICROCONTROLLER REGISTERS
[0238] Register File Map
[0239] The register file 312 is divided into eight banks (FIG. 16). Each bank is dedicated to a pair of ingress and egress tasks from the same channel 150.x. In some embodiments, the ingress task uses more registers than an egress task because ingress processing is more complex. In some embodiments, task software is such that there are no common registers between the two tasks.
[0240] Each register r0.0-r7.7 is 1 byte wide. 8 consecutive bytes can be read in parallel from the register file. To form a 7-bit address of an 8-byte register word, the register number (0 through 63) is concatenated with the bank ID which itself is a concatenation of the channel ID “CHID” and the task pair number SN (0 or 1); the address MSB is 0 to indicate register file 312 (versus special registers 314).
[0241] Microcontroller Register Map
[0242] All registers in the microcontroller are directly accessible through microcontroller commands. The register map is divided into two regions: register file 312 and special registers 315. A register address consists of 7 bits. For the special registers 315, the address MSB is 1; for the register file 312, the MSB is 0.
[0243] Data Memory 316
[0244] Data memory 316 (FIG. 17) is used for temporary storage of variables as well as for some parameters described below.
[0245] Data memory 316 is therefore divided into three regions:
[0246] a. For each task, tasks registers tr0-tr5 (6 per task). These registers are dedicated to the respective task.
[0247] b. Channel registers cr0-cr3 (4 per channel 150.x). These registers are dedicated to a hardware task. All tasks of the same channel (two ingress and two egress tasks) have access to these registers.
[0248] c. Global registers gr (16 registers). These registers are global for all the tasks.
[0249] Data memory 316 is 128 words of 32 bits.
[0250] The 7-bit address generation scheme for data memory 316 is shown in FIG. 18, where:
[0251] tr is Task Register number (0-5).
[0252] tn is Task Number (0-15) (tr and tn form a task register address).
[0253] cr is Channel Register number (0-3; “110,” cr, cn form a channel register address).
[0254] cn is Channel Number (0-3).
[0255] gr is Global Register number (0-15).
[0256] Special registers (SR) 315 (see the table A6-1 below) are directly accessible through microcontroller commands (similar to the register file). Special registers 315 may be divided into three types:
[0257] a. registers which belong to a task, such as Program Counter (PC), Task Number (TIN), etc.
[0258] b. resource registers, such as Request FIFO (reqf), Status FIFO (sttf), Search Machine Command (scmd), etc. (see Addendum 2).
[0259] c. Data memory 316 registers, such as task registers (tr), channel registers (cr) and global registers (gr).
[0260] The resources and the data memory 316 (note types b and c) are mapped into the special registers to simplify their access.
[0261] Pertinent special registers are summarized in the following table.
[0262] Register fields of some special registers are as follows:
[0263] PC—Program Counter & Flags
[0264] PC (10 bits) Program Counter
[0265] G (1 bit) Flag—Greater
[0266] L (1 bit) Flag—Less
[0267] E (1 bit) Flag—Equal
[0268] C (1 bit) Flag—Carry G, L, E, and C are read-only.
[0269] TN—Task Number
[0270] CHID (2 bits) Channel Id
[0271] SN (1 bit) Sequence Number
[0272] I/E (1 bit) Ingress(0)/Egress(1)
[0273] SCMD,SCMDE—Command and Command Extension
[0274] During write operations these 32-bit registers form a command for the search machine. During read operations these registers provide the result.
[0275] SCMDE should be written prior to SCMD.
[0276] XFREEL—External Free List
[0277] A write to this register causes adding a block to the free list stack in external memory 200. A read from this register causes removing a block from the stack.
[0278] There is one free list stack per channel. Each register contains a 16-bit pointer to the top of the stack.
[0279] TIMER—general timer
[0280] Timer (32 bits) Timer value. The timer is a free running counter advanced every 8 system clock ticks.
[0281] NXTE (16 bits) Pointer to the next entry to examine for aging. This field is write only. Should be initialized after reset.
[0282] ET (1 bit) Enable Timer Update. This field is used during write operations. If ET=1, the timer counter gets the value being written. If ET=0, the timer counter is not affected by the write.
[0283] EN (1 bit) Enable Next Entry Update. This field is used during write operations. If EN=1, the NXTE pointer gets the new value. If EN=0, the NXTE field is invalid.
[0284] SMCNTL—Search Machine Control register
[0285] Pointer (16 bits) Node area start pointer. This pointer defines the search node area (the bottom of this area is 0xFFFF). The automatic aging mechanism will be performed only inside this area.
[0286] AGE (1 bit) Aging Enable (0-disable; 1-enable).
[0287] FLCNT—Free list counter
[0288] This read only register contains the number of entries in the free list in the scratch pad area of memory 170.
[0289] Count (17 bits) Counter (max value is 0×10000)
[0290] AGEL0, AGEL1—head of age list 0,1
[0291] These are read only registers (two per channel). Each contains the top of the age list (there are two age lists per channel). A read from any one of these registers causes the register to clear. Of note, the TSTMP (time stamp) field in the node (Addendum 8) is used to link nodes together in this list. When the register is 0, the list is empty.
[0292] Pointer (16 bits) Top of the List pointer.
[0293] THRSHL0, THRSHL1—Threshold register
[0294] Each of these registers contains the threshold associated with the corresponding Age List.
[0295] When |current_time—timestamp|>threshold, and the entry is of type LRND (learned entry), the entry is added to the Age List. threshold (16 bits) Threshold value
[0296] MSGR—Message Register is used to transfer messages between the microcontroller and switch 120 CPU (not shown). The messages are transferred through the Header line.
[0297] MSGA (16 bits) Message to CPU when writing MSGR, and from CPU when reading the register. This field is cleared after read.
[0298] MSGB (16 bits) Message to CPU when reading the register (for testing).
[0299] DMAA—DMA Address
[0300] OP (3 bits) Operation
[0301] 000—nop
[0302] 001—Load from EPROM 204
[0303] 010—Load from switch 120
[0304] 111—Release
[0305] EPA (13 bits) EPROM Start Address
[0306] LER (1 bit) Load Error
[0307] PMA (10 bits) Program Memory Address
[0308] SEMR—Semaphore Register
[0309] S[i] (1 bit) Semaphore bit “i”
[0310] IFREER—Internal Free Register (16 bits)
[0311] F[i] (1 bit) indicates whether Block “i” in the scratch pad area of memory 170 is free.
[0312] IFREEL—Internal Free List
[0313] BLKN (5 bits) Free Block Number (i.e. scratch buffer number; see FIG. 15). A read of this register removes the scratch buffer BLKN from the free list. A write to this register returns to the free list the buffer identified by the BLKN value being written.
[0314] MIIR—MII control register
[0315] This register is used to communicate with Ethernet PHY devices through MII control interface.
[0316] BSY (1 bit) Busy.
[0317] Set with a new command, and reset when the command is done.
[0318] CMD (4 bits) Command
[0319] 1000—Scan On
[0320] 0000—Scan Off
[0321] 0100—Send Control Info
[0322] 0010—Read Status
[0323] NV (1 bit) Not Valid. Set when the data from PHY is not valid.
[0324] FIAD (5 bits) PHY Address.
[0325] RGAD (5 bits) Register Address.
[0326] Data (16 bits) Data.
ADDENDUM 7
MICROCONTROLLER INSTRUCTIONS
[0327] Three Operand Instructions
[0328] These instructions perform arithmetic and logic operations between Operand_A and Operand_B. The result is written to Operand_C. The instructions are:
[0329] ADD—Add
[0330] SUB—Subtract
[0331] OR—Logical OR
[0332] AND—Logical AND
[0333] XOR—Logical XOR
[0334] SHL—Shift Left
[0335] SHR—Shift Right
[0336] BITC—Bit Change
[0337] The instruction Size field specifies the operand sizes.
[0338] A two-bit “dt” field (destination type) in the instruction specifies the type of Operand_C as follows:
[0339] dt=00—Operand_C is a register in register file 312 or special registers 315.
[0340] dt=10—Operand_C is in memory 170. The Operand_C field is used as 7 bits immediate value in the Load/Store Unit for address generation.
[0341] dt=x1—Operand_C is in external memory 200. The Operand_C field together with dt[1] bit is used as an 8 bit immediate value in the Load/Store Unit for address generation.
[0342] Note that instructions with non-zero dt cannot use resources as their operands.
[0343] Two Operand Instruction with an Immediate Byte
[0344] These instructions perform arithmetic or logic operation between Operand_A and an immediate byte. The result is written to Operand_C. The instructions are:
[0345] ADI—Add Immediate
[0346] SBI—Subtract Immediate
[0347] ORI—Logical OR Immediate
[0348] ANDI—Logical AND Immediate
[0349] XORI—Logical XOR Immediate
[0350] SHLI—Shift Left Immediate
[0351] SHRI—Shift Right Immediate
[0352] BITCI—Bit Change Immediate
[0353] The Size field specifies the sizes of operands.
[0354] A two-bit “dt” field (destination type) of the instruction specifies the type of the Operand_C field as in the three-operand instructions.
[0355] Two Operand Instructions
[0356] These instructions perform move and compare operations between two operands. The instructions are:
[0357] MOVE—MOVE Operand A to Operand C
[0358] CMP—Compare Operand C to Operand A
[0359] The size field of the instruction specifies the sizes of operands.
[0360] One Operand Instructions with Immediate
[0361] These instructions perform move and compare operations between an operand and an immediate field. The instructions are:
[0362] MVIW—MOVE Immediate Word
[0363] MVIB—MOVE Immediate Byte
[0364] CPIB—Compare Immediate Byte
[0365] CPIW—Compare Immediate Word
[0366] The size field of the instruction specifies the size of Operand_C.
[0367] Special One Operand Instructions with Immediate Field
[0368] These instructions perform an operation on Operand C as follows:
[0369] SMWR—Search Machine Write
[0370] CMD—Channel Command Write
[0371] CASE—Case statement
[0372] BTJ—Bit Test and Jump
[0373] Load & Store Instructions
[0374] These instructions perform Load and Store operation between Operand A and memory 170 or 200. The instructions are:
[0375] LOAD
[0376] STORE
[0377] The “dt” field (destination type) specifies the type of destination as follows:
[0378] dt=10—Destination is memory 170. The immediate field is used as a 7 bit immediate value in the Load/Store Unit for address generation.
[0379] dt=x1—Destination is memory 200. The immediate field together with the dt[1] bit is used as an 8 bit immediate value in the Load/Store Unit for address generation.
[0380] Special Immediate Instruction
[0381] This instruction is CMDI (Command Immediate). It is used to write to a command FIFO.
[0382] Selected Instructions
[0383] ADD, SUB, ADI, SBI
[0384] Flags:
[0385] E is set when result is equal to zero
[0386] C is set when Carry (for ADD, ADI) or Borrow (for SUB, SBI) is generated (based on operand opC size)
[0387] OR, AND, XOR, SHL, SHR, ORI, ANDI, XORI, SHLI, SHRI
[0388] Flags:
[0389] E is set when result is equal to zero
[0390] BITC—Bit Change.
[0391] Operands: bits [31:25]=opC, [24:18]=opA, [17:16]=dt, [14:8]=opB, [7]=v
[0392] Operation: opC<-opA[opB]<-v (i.e. opC receives the value of opA except that the bit number opB in opC is set to v)
[0393] Flags:
[0394] E is set when (opA[opB]==v)
[0395] BITCI—Bit Change immediate
[0396] Operands: bits [31:25]=opC, [24:18]=opA, [17:16]=dt, [12:8]=imm, [7]=v
[0397] Operation: opC<-opA[imm]<-v
[0398] Flags:
[0399] E is set when (opA[imm]==v)
[0400] CMP—Compare
[0401] Operands: bits [31:25]=opC, [24:18]=opA, [7:5]=operand size
[0402] Operation: opC?opA
[0403] Flags:
[0404] E is set when (opC==opA)
[0405] G is set when (opC>opA)
[0406] L is set when (opC<opA)
[0407] CPIW—Compare immediate word
[0408] Operands: bits [31:25]=opC, [23:8]=imm
[0409] Operation: opC?imm
[0410] Flags:
[0411] E is set when (opC==imm)
[0412] G is set when (opC>imm)
[0413] L is set when (opC<imm)
[0414] CPIB—Compare immediate byte
[0415] Operands: bits [31:25]=opC, [23:16]=bit_mask, [15:8]=imm
[0416] Operation: (bit_mask & opc)?imm
[0417] Flags:
[0418] E is set when ((bit_mask&opC)==imm)
[0419] G is set when ((bit_mask&opC)>imm)
[0420] L is set when ((bit_mask&opC)<imm)
[0421] LOAD—Load from internal or external memory
[0422] Operands: bits [31:25]=aop, [24:18]=opA, [17:16]=dt, [7]=i, [6]=f
[0423] Operation:
[0424] if [dt==10] opA<-IM[{aop,imp}]; imp=imp+i;
[0425] if [dt==x1] opA<-XM[{aop,xmp}]; xmp=xmp+i;
[0426] IM is internal memory 170; imp is the internal memory pointer register (Table A6-1);
[0427] XM is external memory 200; xpm is the external memory pointer register (Table A6-1).
[0428] When the f bit is set, the execution of load instruction is delayed if previous store operation from the same channel is not complete.
[0429] aop is address bits concatenated with imp or xmp indicates concatenation).
[0430] STORE—Store to internal or external memory
[0431] Operands: bits [31:25]=aop, [24:18]=opA, [17:16]=dt, [7]=i
[0432] Operation:
[0433] if [dt==10] opA->IM[{aop,imp}]; imp=imp+i;
[0434] if [dt==x1] opA->XM[{aop,xmp}]; xmp=xmp+i;
[0435] IM, XM, imp, xmp, and aop have the same meaning as for the LOAD instruction.
[0436] SMWR—Search Machine command Write
[0437] Operands: bits [31:25]=opC, [23:8]=imm
[0438] Operation: scmd<- {opC[63:16], imm}
[0439] CMDI—Immediate Command to Channel
[0440] Operands: bits [31:8]=imm, [7]=L, [6]=P
[0441] Operation:
[0442] Command_port<-{40′b0, imm} where 40′b0 denotes 40 binary zeroes.
[0443] if P=0, Command_port=cmd_i; (Ingress Command)
[0444] if P=1, Command_port=cmd_e; (Egress Command)
[0445] The instruction L flag (1 bit) is Lock/Unlock control (when set, the lock state in the instruction is changed)
[0446] CMD—Command to Channel
[0447] Operands: bits [31:25]=opC, [23:8]=imm, [7]=L, [6]=P
[0448] Operation:
[0449] Command_port<-{opC[63:16], imm}
[0450] if P=0, Command_port=cmd_i; (Ingress Command)
[0451] if P=1, Command_port=cmd_e; (Egress Command)
[0452] The 1-bit L flag in the instruction is Lock/Unlock control (when set, the lock state is changed)
[0453] CASE
[0454] Operands: bits[31:25]=opC, [23:16]=bit_mask, [12:8]=shift
[0455] Operation: PC<-PC+((opC&bit_mask)>>shift)+1
[0456] BTJ—Bit test and jump
[0457] Operands: bits [31:25]=opC, [24:13]=addr, [12:8]=bit, [7]=v
[0458] Operation: if (opC[bit]==v) then PC<-addr
ADDENDUM 8
SEARCH MACHINE
[0459] The search machine uses the well-known PATRICIA tree structure (see U.S. Pat. No. 5,546,390 “Method and Apparatus for Radix Decision Packet Processing” issued Aug. 13, 1996 to G. C. Stone and incorporated herein by reference).
[0460] FIG. 19 Illustrates tree nodes 2400. Each node is four 64-bit words long. The node formats areas follows.
Search Machine Commands
Claims
What is claimed is:
1. An apparatus comprising a computer processor for executing a plurality of predefined groups {G1} of tasks that process network data during consecutive time slots of equal length, wherein each task group G1 comprises a plurality of tasks, the computer processor comprising:
a task selection circuit for associating each time slot with a task group G1 and for selecting, for each time slot, one of the tasks from the associated task group G1, wherein any two consecutive time slots are associated with respective different task groups G1; and
an instruction execution unit which is, in each time slot, to initiate execution of at most one instruction for the task selected for the time slot.
2. The apparatus of claim 1 wherein the task selection circuit comprises:
a selection circuit for selecting a task from the tasks of a single task group G1 based on task information determining, for each task in the group G1, whether or not the task is available for execution; and
a plurality of latch circuits each of which is to hold the task information for one task group G1, wherein in each time slot, the contents of each latch circuit are transferred to the next latch circuit and the contents of the last latch circuit are provided to the selection circuit.
3. The apparatus of claim 1 further comprising a plurality of resources each of which may or may not be available to a task at any given time, wherein each resource is shared by tasks of only one task group G1.
4. The apparatus of claim 1 wherein the apparatus is to receive frames of data from one or more network segments and/or transmit frames of data to one or more network segments, wherein each frame of data is to be processed by a single one of the tasks.
5. The apparatus of claim 1 further comprising a plurality of first circuits which are to receive network data on a plurality of network ports and/or transmit network data on the network ports, wherein different first circuits are to receive and/or transmit data on respective different network ports, and wherein each task group G1 is associated with one of the first circuits, each task group G1 being to process network data received and/or transmitted by the associated first circuit.
6. The apparatus of claim 5 wherein each first circuit is to receive and/or transmit network data on only one port.
7. The apparatus of claim 5 wherein the first circuits provide an interface between the network ports and a network switch.
8. The apparatus of claim 1 further comprising a plurality of first circuits each of which is to receive and/or transmit network data on one or more respective network data flows, wherein different first circuits are to receive and/or transmit data on respective different flows, and wherein each task group G1 is associated with one of the first circuits, each task group G1 being to process network data received and/or transmitted by the associated first circuit.
9. The apparatus of claim 8 wherein each task group G1 corresponds to a network port, and the tasks of each task group G1 process data flows to and from the corresponding network port.
10. The apparatus of claim 8 wherein each task group G1 comprises at least two tasks to process data of each data flow.
11. The apparatus of claim 1 further comprising a program counter register for each task,
wherein in each time slot, (a) if a task is selected for the time slot, then the instruction execution unit is to initiate execution for an instruction identified by the selected task's program counter register, and (b) if no task is selected for the time slot, then the execution unit is to initiate execution of a NOP instruction.
12. The apparatus of claim 1 wherein the instruction execution unit includes, for each task, one or more registers storing task-specific values, such that no one of the one or more registers has to be saved or restored when a task is scheduled for execution.
13. An apparatus comprising a computer processor for executing a plurality of predefined groups {G1} of tasks that process network data, wherein each task group G1 comprises a plurality of tasks, the computer processor comprising:
a task selection circuit for performing consecutive task selection operations, each task selection operation being associated with a group G1 to select one of the tasks from the associated group G1, wherein any two consecutive task selection operations are associated with respective different task groups G1;
an instruction execution unit for executing instructions for the tasks selected by the consecutive task selection operations, wherein for each task selection operation the instruction execution unit is to initiate execution of at most one instruction for the corresponding selected task.
14. The apparatus of claim 13 wherein the task selection circuit comprises:
a selection circuit for selecting a task from the tasks of a single task group G1 based on task information determining, for each task in the group G1, whether or not the task is available for execution; and
a plurality of latch circuits each of which is to hold the task information for one task group G1, wherein after each task selection operation, the contents of each latch circuit are transferred to the next latch circuit and the contents of the last latch circuit are provided to the selection circuit.
15. The apparatus of claim 13 further comprising a plurality of resources each of which may or may not be available to a task at any given time, wherein each resource is shared by tasks of only one task group G1.
16. The apparatus of claim 15 wherein the resources comprise request FIFOs for storing requests to the computer processor to process network data, and command FIFOs for storing commands from the processor to be applied to network data.
17. The apparatus of claim 13 further comprising a plurality of first circuits which are to receive network data on a plurality of network ports and/or transmit network data on the network ports, wherein different first circuits are to receive and/or transmit data on respective different network ports, and wherein each task group G1 is associated with one of the first circuits, each task group G1 being to process network data received and/or transmitted by the associated first circuit.
18. The apparatus of claim 17 wherein each first circuit is to receive and/or transmit network data on only one port.
19. The apparatus of claim 13 further comprising a plurality of first circuits each of which is to receive and/or transmit network data on one or more respective network data flows, wherein different first circuits are to receive and/or transmit data on respective different flows, and wherein each task group G1 is associated with one of the first circuits, each task group G1 being to process network data received and/or transmitted by the associated first circuit.
20. The apparatus of claim 19 wherein each task group G1 corresponds to a network port, and the tasks of each group process data flows to and from the corresponding network port.
21. A method comprising executing a plurality of predefined groups {G1} of tasks {TSK1} by circuitry comprising an instruction execution circuit, wherein the tasks TSK1 process network data received and/or transmitted over a network, wherein the instruction execution circuit is operable to start executing an instruction in each time slot T1 in a plurality of consecutive time slots of equal length, and executing the plurality of tasks comprises:
associating each time slot T1 with a task group G1(T1), which is one of said predefined task groups, so that any two consecutive time slots are associated with respective different groups G1;
for each time slot T1, performing a task selection operation TSOP1(T1) to select a task from the group G1(T1) associated with the time slot T1; and
in each time slot T1, if a task was selected successfully by the task selection operation TS0P1(T1), the instruction execution circuit initiating execution of an instruction for the task selected for the time slot.
22. The method of claim 21 wherein the tasks TSK1 share resources each of which may or may not be available to a task at any given time, wherein each resource is shared by the tasks of only one task group G1.
23. The method of claim 21 wherein the tasks TSK1 extract address information from the network data and perform address translation.
24. The method of claim 21 wherein the tasks TSK1 process network data of a plurality of network data flows, wherein network data are received and/or transmitted by a plurality of circuits C1, each circuit C1 receiving and/or transmitting data on one or more respective data flows such that different circuits C1 receive and/or transmit network data on respective different flows, wherein each circuit C1 corresponds to a group G1 whose tasks operate on data received and/or transmitted by the circuit C1.
25. The method of claim 24 wherein each group G1 corresponds to a network port, and the tasks of each group G1 process data flows to and from the corresponding network port.
26. A method comprising executing a plurality of predefined groups {G1} of tasks {TSK1} by circuitry comprising an instruction execution circuit, wherein the tasks TSK1 process network data received and/or transmitted over a network, wherein executing the plurality of tasks comprises:
for each instruction to be executed by the instruction execution circuit, performing a selection operation to select a task TSK1 whose instruction is to be executed, wherein each selection operation is associated with a group G1 to select a task from the group G1 if the group G1 has a task available of execution, wherein any two consecutive selection operations are associated with respective different groups G1; and
for each selection operation which results in a selection of a task, the instruction execution circuit executing an instruction for the selected task.
27. The method of claim 26 further comprising receiving frames of data from one or more network segments and/or transmitting frames of data to one or more network segments, wherein each frame of data is processed by a single task TSK1.
28. The method of claim 26 wherein the tasks TSK1 share resources each of which may or may not be available to a task at any given time, wherein each resource is shared by the tasks of only one task group G1.
29. The method of claim 26 wherein the tasks TSK1 extract address information from the network data and perform address translation.
30. The method of claim 24 wherein the circuits C1 provide an interface between the network ports and a network switch.
31. The method of claim 26 wherein the tasks TSK1 process network data of a plurality of network data flows, wherein network data are received and/or transmitted by a plurality of circuits C1, each circuit C1 receiving and/or transmitting network data on one or more respective data flows such that different circuits C1 receive and/or transmit network data on respective different flows, wherein each circuit C1 corresponds to a group G1 whose tasks operate on data received and/or transmitted by the circuit C1.
32. The method of claim 31 wherein each group G1 corresponds to a network port, and the tasks TSK1 of each group G1 process data flows to and from the corresponding network port.
33. The method of claim 31 wherein each group G1 comprises at least two tasks TSK1 to process data of each data flow.
34. A method comprising executing computer instructions for a plurality of tasks to process network data for a plurality of network ports, wherein network data are received and/or transmitted by a plurality of port circuits such that different port circuits receive and/or transmit network data on respective different network ports, wherein each port circuit corresponds to a plurality of corresponding tasks which operate on data received and/or transmitted by the port circuit,
wherein for each computer instruction to be executed for the tasks, the method comprises:
determining a port circuit P1 for which the instruction is to be executed, such that any two consecutive instructions are executed for respective different port circuits;
performing a task selection operation to select one of the tasks corresponding to the port circuit P1;
if the task selection operation results in a selection of a task, then executing an instruction for the selected task;
if the task selection operation does not result in a selection of a task due to none of the tasks corresponding to the port circuit P1 being available to be executed, than executing a NOP instruction.
35. A method for executing a plurality of software tasks by a pipelined network processor which controls a port interface circuit which processes network data received on a plurality of network ports and/or network data transmitted on the network ports, wherein the port interface circuit comprises a plurality of hardware tasks such that different hardware tasks process network data for respective different network ports, and wherein each software task operates on data processed by a corresponding one of the hardware tasks, and each hardware task corresponds to a plurality of the software tasks,
wherein in each of consecutive time slots of equal length, the pipelined processor is operable to start execution of an instruction while continuing to execute a previous instruction,
the method comprising:
associating each time slot with a hardware task so that in each time slot, the processor is to start execution of an instruction of a software task corresponding to the associated hardware task if a software task corresponding to the associated hardware task is available for execution, wherein any two consecutive time slots are associated with respective different hardware tasks;
for each time slot, selecting a software task corresponding to the hardware task associated with the time slot if a software task corresponding to the hardware task associated with the time slot is available for execution; and
in each time slot, if a software task corresponding to the hardware task associated with the time slot is available for execution, then starting execution of an instruction from the software task selected for the time slot.
36. An apparatus comprising a computer processor for executing a plurality of predefined groups of tasks that process network data during consecutive time slots of equal length, wherein each predefined group of tasks comprises a plurality of tasks, the computer processor comprising:
a task selection circuit for selecting, in each time slot, a task from a predefined group of tasks, wherein in any two consecutive time slots the task selection circuit is to select tasks from respective different predefined groups of tasks; and
an instruction execution unit which is to initiate execution of at most one instruction for a task each time the task is selected.
37. The apparatus of claim 36 wherein the tasks share resources each of which may or may not be available to a task at any given time, wherein each resource is shared by tasks of only one of the predefined groups of tasks.
38. The apparatus of claim 36 further comprising a plurality of first circuits each of which is to receive and/or transmit network data on one or more respective network data flows, wherein different first circuits are to receive and/or transmit data on respective different flows, and wherein each predefined group of tasks is associated with one of the first circuits, each predefined group of tasks being to process network data received and/or transmitted by the associated first circuit.
39. A network apparatus comprising a computer processor for executing a plurality of tasks during consecutive time slots of equal length, wherein each task is to process network data received on one or more network data flows corresponding to the task and/or transmitted on one or more network data flows corresponding to the task, the computer processor comprising:
a task selection circuit for selecting a task in each time slot, wherein for any two tasks TSK1 and TSK2 selected in two consecutive time slots, the one or more network data flows processed by the task TSK1 are different from the one or more data flows processed by the task TSK2 so that there is no data flow processed by both of the tasks TSK1 and TSK2; and
an instruction execution unit which is to initiate execution of at most one instruction for a task each time the task is selected.
40. A network apparatus comprising a computer processor for executing a plurality of tasks, wherein each task is to process data received on a corresponding network port or transmitted on a corresponding network port, the computer processor comprising:
a task selection circuit for selecting a task in each time slot, such that any two tasks selected in two consecutive time slots of equal length are to process data for respective different ports; and
an instruction execution unit which is to initiate execution of at most one instruction for a task each time the task is selected.
Patent Citations (34)
| Patent | Date | Inventor | Cited By |
|---|---|---|---|
| US2686844 | 1954-08-01 | Brewer | Applicant |
| US4885744 | 1989-12-01 | Lespagnol et al. | Applicant |
| US5058144 | 1991-10-01 | Fiala et al. | Applicant |
| US5062106 | 1991-10-01 | Yamazaki | Applicant |
| US5233606 | 1993-08-01 | Pashan et al. | Applicant |
| US5261062 | 1993-11-01 | Sato | Examiner |
| US5311509 | 1994-05-01 | Heddes et al. | Applicant |
| US5337308 | 1994-08-01 | Fan | Applicant |
| US5357617 | 1994-10-01 | Davis et al. | Examiner |
| US5457687 | 1995-10-01 | Newman | Applicant |
| US5517495 | 1996-05-01 | Lund et al. | Applicant |
| US5528588 | 1996-06-01 | Bennett et al. | Applicant |
| US5541912 | 1996-07-01 | Choudhury et al. | Applicant |
| US5546390 | 1996-08-01 | Stone | Applicant |
| US5555264 | 1996-09-01 | Sallberg et al. | Applicant |
| US5557611 | 1996-09-01 | Cappellari et al. | Applicant |
| US5583863 | 1996-12-01 | Darr, Jr. et al. | Applicant |
| US5592476 | 1997-01-01 | Calamvokis et al. | Applicant |
| US5629928 | 1997-05-01 | Calvignac et al. | Applicant |
| US5633859 | 1997-05-01 | Jain et al. | Applicant |
| US5633867 | 1997-05-01 | Ben-Num et al. | Applicant |
| US5689508 | 1997-11-01 | Lyles | Applicant |
| US5704047 | 1997-12-01 | Schneeberger | Applicant |
| US5715250 | 1998-02-01 | Watanabe | Applicant |
| US5719853 | 1998-02-01 | Ikeda | Applicant |
| US5748629 | 1998-05-01 | Caldara et al. | Applicant |
| US5751951 | 1998-05-01 | Osborne et al. | Applicant |
| US5809024 | 1998-09-01 | Ferguson et al. | Applicant |
| US5983004 | 1999-11-01 | Shaw et al. | Examiner |
| US6018759 | 2000-01-01 | Doing et al. | Examiner |
| US6233590 | 2001-05-01 | Shaw et al. | Examiner |
| WO95/20282 | 1995-07-01 | Applicant | |
| WO95/32570 | 1995-11-01 | Applicant | |
| WO98/09409 | 1998-03-01 | Applicant |
Non-Patent Literature (14)
- “An Overview of ATM LAN Emulation”, World Wide Web, Interphase Corporation, Mar. 1996, pp. 1-8.Applicant
- “LAN Emulation”, World Wide Web, Nov. 1995, pp. 1-18.Applicant
- B. Klessig, “ATM LAN Emulation”, World Wide Web, 3Com Corporation, pp. 1-20.Applicant
- “ATM Internetworking”, World Wide Web, Cisco Systems, Inc., 1995, pp. 1-60.Applicant
- Allyn Romanow et al. “Dynamics of TCP Traffic Over ATM Networks” IEEE Journal of Selected Areas in Communications, vol. 13, No. 4, pp 633-641, May 1995.Applicant
- Alan Demers et al. “Analysis and Simulation Of A Fair Queueing Algorithm” ©1989 ACM, pp. 1-12.Applicant
- “ATMS2003B Switch Controller 1 “White””, MMC Networks, Dec. 1995, 32 pages.Applicant
- Beraldi, R., et al: “Selective BECN Schemes for Congestion Control of ABR Traffic in ATM LAN”, 1996 IEEE Int'l Conf. on Communications (ICC), Converging Technologies for Tomorrow's Applications, Dallas, Jun. 23-27, 1996. pp. 503-507.Applicant
- Dutton, Harry, J.R. and Lenhard, Peter, “Asynchronous Transfer Mode (ATM) Technical Overview” (IBM, Prentice-Hall PTR, New Jersey, 1995), pp. 3-1 through 3-25 and 9-1 thourgh 9-34.Applicant
- Flanagan, William A., “ATM (Asyncrhronous Transfer Mode) User's Guide,” (Flatiron Publishing, Inc. New York, 1994), pp. 25-49.Applicant
- Hongqing Li et al. “A Simulation Study of TCP Performance in ATM Networks With ABR and UBR Services” Proceedings vol. 3, 1996 IEEE Infocom '96, Fifteenth Annual Joint Conference of the IEEE Computer and Communications Societies, Mar. 24-28, 1996, pp v-xvi and pp 1269-1276 (21 pages total including cover page).Applicant
- Hongqing, Li, et al.: “Performance of TCP Over UBR Service in ATM Networks With Per-VC Early Packet Discard Schemes” Proceedings of the 1996 IEEE 15th Annual Int' Phoenix Conf. on Computers and Communication, Mar. 27-29, 1996, pp. 350-357.Applicant
- Ozveren, C., et al: “Reliable and Efficient Hop-By-Hop Flow Control”, Computer Communications Review, vol. 24, No. 4, Oct. 1, 1994, pp. 89-100.Applicant
- Tanenbaum, Andrew S., “Computer Networks” (Prentice Hall PTR, 3rd Ed., 1996) pp. 148-150.Applicant