Prioritizing data transfers over data buses

[0001] This application is a continuation application of U.S. patent application Ser. No. 09/469,960, filed Dec. 21, 1999 now U.S. Pat No 6,892,243. The disclosure of the prior application is considered part of (and is incorporated by reference in) the disclosure of this application.

[0002] This application relates to data transfers on a data bus, such as the “Universal Serial Bus” (USB) found in many personal computer systems.

[0003] Data buses are used to transfer data between devices in computer systems. In general, a data bus can transfer only a certain amount of data in a given amount of time and thus has limited “bandwidth.” Some data buses, such as a “Universal Serial Bus” (USB), support more than one type of data transfer, each with its own bandwidth and priority requirements. USB, for example, supports two types of streaming transfers for bi-directional data, known as “isochronous” transfers and “bulk” transfers.

[0004] In the USB environment, isochronous transfers are used for higher priority data, such as packetized voice data, that must reach the intended target within a bounded period of time. Isochronous transfers therefore attempt to guarantee at least some minimum bandwidth on the bus. Bulk transfers, on the other hand, are used with lower priority data, such as normal Internet traffic, for which only a guarantee of delivery is required. Bulk transfers do not guarantee bandwidth or priority on the bus.

[0005] In a conventional computer system, each network-interfacing device places all traffic that arrives over the network into a single queue. For a USB device, such as a USB broadband modem, this means that all incoming data is placed in a single queue, regardless of the data's priority. Therefore, the delivery of higher priority data is often delayed by the presence of lower priority data in the queue. This makes it difficult to provide guaranteed bus bandwidth to the higher priority data.

[0006] A computer system includes a host processor and a peripheral device coupled by an attachment bus. The peripheral device transfers data to the host processor over the attachment bus using at least two types of data transfers. The peripheral device includes a classifying circuit that separates the data into a first class associated with a first type of transfer and a second class associated with a second type of transfer. The peripheral circuit also includes two queues, including a first queue that receives the first class of data from the classifying circuit and a second queue that receives the second class of data from the classifying circuit. A control circuit places data from the first queue onto the bus with higher priority than data from the second queue is placed onto the bus.

[0007] Other embodiments and advantages will become apparent from the following description and from the claims.

[0009] FIG. 1 shows a computer system 100 in which a host device 105 communicates with a peripheral device 110, such as a broadband modem, over a bi-directional data bus 115, such as a “Universal Serial Bus” (USB) or a “Peripheral Component Interface” (PCI) bus. The peripheral device 110 also connects to a computer network 120, such as the Internet or a private intranet. The peripheral device includes a device-bus interface component 125 that allows the device to send and receive data over the data bus 115. Likewise, the peripheral device 110 includes a network interface component 130 that allows the device to send and receive data over the network 120. The host device 105 includes a host-bus interface 135 that allows the host device 105 to send and receive data over the data bus 115.

[0010] Some of the data flowing through the peripheral device 110 has higher priority than other data flowing through the device and therefore must be handled more reliably. For example, packetized voice data must reach its intended target in a manner that has very little, if any, effect on the reproduced sound quality. Many types of Internet traffic, on the other hand, generally does not need to reach its intended target with any particular urgency.

[0011] When the data bus 115 is a USB bus, isochronous transfers, or “guaranteed service” transfers, are used to deliver higher priority data, such as packetized voice data, between the peripheral device 110 and the host processor. USB uses bulk transfers, or “best effort service” transfers, to deliver lower priority data, such as normal Internet traffic.

[0012] The host device 105 and the peripheral device 110 both include components that distinguish between higher priority data and lower priority data. These components ensure that the higher priority data is delivered with greater reliability.

[0013] The host device 105 typically includes the computer's base board, on which a host processor 140 and host memory device 145 reside. The host processor 140 executes a variety of application programs, including applications that require guaranteed service, such as packetized voice applications 150, and programs that require only best-effort service, such as Internet browsing applications 155. The host processor 140 also implements a traffic shaping component 160, which receives data addressed to the network and separates the data into higher priority and lower priority blocks. The host processor 140 implements the application programs 150, 155 and the traffic shaping component 160 by retrieving executable instructions from a storage device, such as the host memory device 145, and executing these instructions.

[0014] The host memory device 145 includes storage elements that are partitioned to form two or more data queues 165, 170, 175. At least one queue is a “highest priority” queue 165 dedicated to storing data generated by or intended for one of the higher priority applications 150, and at least one queue is a “low priority” queue 175 dedicated to storing data generated by or intended for the lower priority applications 155. In some embodiments, one queue is an “elevated priority” queue 170 dedicated to storing data that is high priority, but that is not as high priority as the data stored in the highest priority queue 165.

[0015] For example, in some embodiments the highest priority queue 165 stores data that must be delivered at a constant bit rate. This data requires the guarantee of a fixed bus bandwidth. The elevated priority queue 170 stores data that can be delivered at a variable, but bounded, bit rate. This data requires the guarantee of some minimum bus bandwidth. The low priority queue 175 stores data that can be delivered at an unspecified bit rate and thus requires no guarantee of bus bandwidth.

[0016] The peripheral device 110 also includes at least two queues, including a “higher priority” queue 180 that stores higher priority data and a “lower priority” queue 185 that stores lower priority data. Data flowing into the peripheral device 110 through the network interface component 120 passes through a traffic classifier component 190. This component separates the incoming data blocks into higher priority and lower priority streams and feeds the streams to the appropriate queues. The device-bus interface 125 places data from the queues 180, 185 onto the data bus 115 in a manner that honors the bandwidth and priority requirements of the data. In general, a minimum amount of data is pulled from the higher priority queue 180 during each time cycle of some predefined length.

[0017] Data flowing into the peripheral device through the device-bus interface 125 arrives from the host device 105. In some embodiments, the peripheral device includes another traffic classifier between the device-bus interface 125 and the queues 180, 185. In most embodiments, however, the host-bus interface 135 in the host device 105 produces a signal indicating the priority of each block of data, so a traffic classifier is not needed between the device-bus interface 125 and the queues 180, 185. The device-bus interface 125 simply directs the incoming data blocks to the appropriate queues based upon the content of this signal.

[0018] FIG. 2 shows one implementation of the traffic classifier component 190 in the peripheral device. This implementation is designed for use with an “Asynchronous Transfer Mode” (ATM) network and a “Universal Serial Bus” (USB).

[0019] Data arriving through the network interface component 130 (FIG. 1) enters a first-in-first-out (FIFO) buffer 200 that holds one data packet, or “cell.” In an ATM environment, each cell includes 53 bytes of data arranged in a commonly-defined configuration. Of the 53 bytes in each cell, four bytes carry a header that, among other things, indicates the packet's virtual channel identifier and Virtual Path Identifier (VCI:VPI). The VCI:VPI typically occupies bits 4-27 in an ATM cell.

[0020] In general, all ATM data cells at a particular priority level are transferred over a known set of virtual channels. Therefore, the peripheral device can derive each cell's priority level based upon the VCI:VPI encoded in the cell's header. The priority level associated with each virtual channel is stored in a content addressable memory (CAM) device 205 in the peripheral device.

[0021] The FIFO buffer 200 transfers the incoming data, one bit at a time, into a four-byte shift register 210. Therefore, in an ATM environment, bits 4-27 in the shift register contain a VCI:VPI once every 53 bytes. The CAM device 205 is programmed to retrieve the VCI:VPI from each data packet by loading these 24 bits once every 53 bytes. Upon loading the VCI:VPI from a data packet, the CAM device 205 compares the packet's VCI:VPI to each of the stored VCI:VPI's that are associated with higher priority cells. If the packet's VCI:VPI matches one of the stored VCI:VPI's, the CAM device 205 enables the higher priority queue 180 and disables the lower priority queue 185, so the incoming packet is stored in the higher priority queue 180. If the packet's VCI:VPI does not match any of the stored VCI:VPI's, the CAM device enables the lower priority queue 185 and disables the higher priority queue 180, and the packet is stored in the lower priority queue 185.

[0022] A device controller 215 in the device-bus interface component 125 (FIG. 1) controls the flow of data from the queues 180, 185 to the data bus. The device controller 215 awards control of the USB to the higher priority queue 180 once each time cycle, e.g., once every millisecond. The device controller 215 awards control of the data bus to the lower priority queue 185 only when the bus is otherwise unoccupied. In this manner, the peripheral device guarantees that higher priority data is delivered at some minimum rate.

[0023] A number of embodiments of the invention are described above. A person of ordinary skill will recognize that various modifications are possible without departing from the spirit and scope of the invention. Accordingly, other embodiments are within the scope of the following claims.