Fair share bandwidth allocation algorithm and device

[0002] This invention relates to the management of data traffic in a network having multi-data streams and more particularly to an algorithm and device for fairly allocating available bandwidth to contending connections in a data network, the allocation being based on global queue size.

[0003] The device and algorithm of the present invention will be described and illustrated with reference to the available bit rate (ABR) service category of an asynchronous transfer mode (ATM) network. It is to be understood, however, that this is only one environment in which this invention finds application.

[0004] As is known the ATM Forum Traffic Management working group has defined five service categories which are distinguished by the parameter sets which describe source behaviour and quality of service guarantees. These five service categories are; constant bit rate (CBR), real-time variable bit rate (rtVBR), non-real-time variable bit rate (nrtVBR), available bit rate (ABR) and unspecified bit rate (UBR). The ABR and UBR service categories are intended to carry data traffic which has no specific cell loss or delay guarantees. The UBR service category is the simplest of the two and may in future provide only a guaranteed minimum cell rate. The ABR service category provides source-to-destination flow control, with minimum cell rate (MCR) guarantee, that attempts but is not guaranteed to achieve zero cell loss. The ABR service category was defined in order to take advantage of available bandwidth within an ATM network during intervals when higher priority traffic was not completely utilizing the network capacity. In order to meet nominal cell loss guarantees ABR traffic employs a feedback loop which effectively monitors congestion at nodes throughout the network and periodically reports back to the source so that data traffic can be adjusted accordingly.

[0005] ABR flow control is achieved by the source sending special resource management (RM) cells through the network. Each switch in the network indicates its congestion status by optionally writing into the RM cell and forwarding the cell into the next switch in the data path. Finally, the destination turns the RM cell back towards the source and the switches in the backward data path mark congestion information into the RM cell which is ultimately received by the source. The source then adjusts its sending rate in response to the information contained in the RM cell.

[0006] The RM cell contains three fields which may be written to in order to describe the congestion status of the switch: a no increase (NI) bit which indicates that the source must not increase its sending rate; a congestion indication (CI) bit which indicates that the source must decrease its sending rate; and an explicit rate (ER) field which contains the minimum explicit rate calculated by any switch in the data path.

[0007] An explicit rate (ER) algorithm must be deployed at any contention point in the data path. For the purpose of this description a contention point is defined as a queuing point in which the aggregate arrival rate of cells is greater than the aggregate service rate. In the context of the present invention the service rate pertains to the capacity available to ABR and is in general time-dependent. A switch may have one or more contention points. An ER algorithm attempts to fairly distribute bandwidth between ABR connections at a contention point.

[0008] It is an object of the present invention to provide a device and algorithm which performs an explicit rate calculation to achieve fair allocation of bandwidth and which requires only an aggregate count of ABR cells.

[0009] Therefore, in accordance with a first aspect of the present invention there is provided a device for fairly allocating available bandwidth between contending connections at a contention point in a switch for processing multi-service traffic streams between a source and a destination comprising; queue monitoring means to continually compare the aggregate queue depth of the aggregate traffic stream at the contention point with a predefined queue depth threshold and periodically generating a function therefrom; an algorithm device for calculating the currently offered bandwidth at the contention point based on the function and the offered bandwidth of a previous calculation; calculating means to periodically generate an offered cell rate value for the contention point based on the currently offered bandwidth and a service weight assigned to the traffic stream; and feedback means to return the offered cell rate value to the source for updating the flow rate of the traffic stream therefrom.

[0010] In a preferred embodiment of the invention the device and algorithm are used in relation to the available bit rate service category in an asynchronous transfer mode communication network.

[0011] In accordance with a second aspect of the present invention there is provided a method of fairly allocating bandwidth between contending connections at a contention point in a switch for processing multi-service cell traffic streams from multiple sources, the method comprising the steps of monitoring the aggregate cell queue depth at the contention point, comparing the aggregate queue depth associated with the aggregate traffic stream at the contention point with a predefined queue depth threshold and periodically generating a function therefrom; calculating the currently offered bandwidth at the contention point based on the aforementioned function and the offered bandwidth of a previous calculation; periodically generating an offered cell rate value for the contention point based on the currently offered bandwidth and a service weight assigned to the traffic stream; and returning the offered cell rate value to the source for updating the flow rate of the traffic stream therefrom.

[0012] In accordance with a third aspect of the present invention there is provided a recursive algorithm for fairly allocating bandwidth between ABR connections at a contention point in an ATM network. The algorithm has the form:

[0013] OBW(k)=g(QD,T)×OBW(k−1)

[0014] where:

[0015] OBW is the total offered bandwidth to all ABR connections;

[0016] QD is the total queue depth utilized by all ABR connections; and

[0017] T is a configurable threshold.

[0018] The invention will now be described in greater detail with reference to the attached drawings wherein:

[0019] FIG. 1 is a block diagram of an ATM network for the ABR service category and

[0020] FIG. 2 illustrates the device and algorithm for fairly allocating available bandwidth according to the present invention.

[0021] FIG. 1 is a simplistic representation of an ATM network for delivering ABR service category traffic. ATM fixed length cells are transmitted from source 12 through network elements 14 to a destination 16. Network elements 14 include switches which respond to header information in the ATM cell in order to direct the cell to the designated destination. Each network element may have one or more congestion points or nodes at which the data traffic contends for service. Higher priority cells such as CBR and rtVBR service categories receive priority while ABR and UBR cells may be placed in queues pending further processing. When the queue depth at contention points in a data path exceed a predefined limit further cells assigned to that path are discarded. As discussed previously ABR cells include resource management cells which include a bit field for recording congestion information throughout the data path. The resource management cells, on reaching the destination, are returned through the network elements to the source where the congestion information is processed so as to control the egress of ABR traffic from the source. The feedback loop is shown by line 18 in FIG. 1.

[0022] The present invention relates to the explicit rate field of the resource management cells as it is this field which contains information respecting available bandwidth and queue lengths through the network.

[0023] Each ABR connection is assigned a weight which may be assigned to be equal to the minimum cell rate (MCR) guaranteed to the connection or may be assigned arbitrarily through the switch configuration.

[0024] A typical requirement of ABR bandwidth distribution between connections at the network level is that max-min fairness be achieved. Max-min fairness is defined as follows:

[0025] Consider a network of multiple switching elements. The network is populated by a number of connections. The goal is to allocate bandwidth at each link so that the link is fully utilized while simultaneously achieving a fair distribution of bandwidth between connections.

[0026] Max-min fairness can be intuitively understood as the distribution of bandwidth between connections, such that each connection receives an end-to-end bandwidth allocation which is equal to its fair share at the point in its path through the network where resources are most scarce. The max-min fair distribution to connections is given by the following iterative definition.

[0027] For each link, reduce the available link bandwidth, LR_j, by an amount equal to the total guaranteed bandwidth of all connections which utilize the link. Assign a weight, W_ij, to each connection, i, and for each link, j, that the connection traverses. The weight is assigned according to the bandwidth distribution method: equal share; MCR proportional; or weight proportional. If a connection does not utilize a particular link, then W_ijis equal to zero. Perform the following steps:

[0028] 1. Let S represent the set of all connections in the network which have not been allocated bandwidth. Calculate the available bandwidth, B_ij, for each connection at each link, by the formula, $B_{\mathrm{ij}}={\mathrm{LR}}_j\times \frac{W_{\mathrm{ij}}}{\sum _{i\in S}{W}_{\mathrm{ij}}}$

[0029] 2. Determine (n,m) by the following formula,

[0030] (n,m)={(i,j)|min(Bij),Ai,j}.

[0031] 3. Let A_irepresent the bandwidth allocated to connection i, and set,

[0032] A_n=B_nm.

[0033] 4. Reduce the available bandwidth, LR_j, on all links which are utilized by connection, n, by the value, A_n. Remove n from the set, S (i.e. it has now been allocated bandwidth). Proceed to step 1 unless the set, S, is empty.

[0034] The number of iterations is equal to the number of connections in the network. When the iterations are complete, the set of values, A_i, represent the max-min bandwidth allocation in the network.

[0035] ER algorithms which attempt to achieve a max-min distribution of bandwidth at the network level are known. One such algorithm described by Cathy Fulton et al, “UT: ABR Feedback Control with Tracking”, ATM Forum 96-1540 Traffic Management, achieves the max-min fairness by attempting to track the total bandwidth available to ABR at a contention point with the aggregate arrival rate. Such an algorithm requires that the switch implement aggregate input and output rate monitoring at each contention point. Another algorithm disclosed by Lampross Kalampoukas, “Dynamics of an Explicit Rate Allocation Algorithm for Available Bit-Rate (ABR) Service in ATM Networks”, UCSC-CRL-95-54, Feb. 1, 1996, measures the bandwidth available to ABR and utilizes per connection input rate monitoring to achieve max-min fairness. Another algorithm disclosed by Kim, Jangkyung, et al, “Fixed Queue Length Control for ABR with Long Propagation”, ATM Forum Document Number 97-0008, utilizes aggregate ABR congestion information to calculate explicit rates but fails to achieve max-min fairness. In this algorithm the bandwidth shared by all ABR connections has a strict upper bound and thus the bandwidth cannot be expected to converge to a value which provides full link utilization under general network conditions.

[0036] All known ER algorithms which achieve max-min fairness require that the bandwidth available to ABR be determined at a contention point by measuring the bandwidth utilized by all higher priority service categories and subtracting the value from the total capacity at the contention point. Such a measurement requires resources and can be prohibitively expensive when there are a large number of contention points in the switch. The present invention provides a device and algorithm which performs an ER calculation achieving max-min fairness and requires only an aggregate count of ABR cells. This is accomplished by satisfying the following two requirements at a contention point:

[0037] 1. The bandwidth available to ABR is fully utilized unless every connection is constrained by another contention point in the data path. The bandwidth available to ABR changes dynamically and is given by the difference between the capacity of the contention point and the bandwidth utilized by higher priority traffic.

[0038] 2. The bandwidth utilized by ABR is apportioned between ABR connections in proportion to the assigned weight of each connection.

[0039] The invention achieves the first requirement by recursively adjusting the total of all explicit rates fed back to the ABR sources until the aggregate ABR queue depth equals a target queue depth. The aggregate queue depth represents the integral of the difference between the aggregate ABR service rate and the arrival rate. An algorithm which causes the aggregate ABR queue depth to converge to a specific threshold will thus ensure that the bandwidth available to ABR is fully utilized over the long term.

[0040] The invention achieves the stated second requirement by dividing the total offered bandwidth between connections according to the weight assigned to each connection.

[0041] FIG. 2 is an illustration of the architecture of the present invention. Both ABR data and RM cell traffic from the source arrives at a contention point which in FIG. 2 is shown as an ABR queue 22. In FIG. 2 ABR queue 22 represents the aggregate count of all ABR cells queued. This construction does not preclude queuing and servicing each connection independently. In FIG. 2 the shaded portion of ABR queue 22 represents the total queue depth utilized by all ABR connections. This is identified as QD in the drawing. The line T is a configurable threshold which represents a preselected target for the queue depth. ABR traffic as well as higher priority traffic contends for the capacity at queuing point 22. The arbiter 24 decides at each cell slot whether to transmit an ABR cell or a higher priority cell. The output cell flow 26 is comprised of both high priority and ABR traffic. Periodically the ABR queue 22 generates the function g(QD,T) and passes the result to the ER algorithm 28. The ER algorithm calculates the offered bandwidth according to the formula

[0042] OBW(k)=g(QD,T)×OBW(k−1)

[0043] where g(QD,T) is given by either $g\left(\mathrm{QD},T\right)=\{\begin{array}{cc}1-x& \mathrm{if}\mathrm{QD}>T\\ 1+x& \mathrm{if}\mathrm{QD}\le T\end{array}$

[0044] The parameter T is a configurable threshold, and x is a small real number in the range [0,1]. The function g(QD,T) is only dependent on global queue congestion and threshold. Alternatively, a function, g(QD,T1,T2) could be defined which takes the form $g\left(\mathrm{QD},\mathrm{T1},\mathrm{T2}\right)=\{\begin{array}{c}1-x\mathrm{if}\mathrm{QD}>\mathrm{T1}\\ 1\mathrm{if}\mathrm{T1}\ge \mathrm{QD}>\mathrm{T2}\\ 1+x\mathrm{if}\mathrm{QD}\le \mathrm{T2}\end{array}$

[0045] This second form employs a dead band in which the offered bandwidth is neither increased or decreased. In general terms the number of bands in the queue depth may be increased such that the update to OBW(k) may assume an arbitrary function in the variable, QD.

[0046] Note that the ABR queue, 22, which generates the function, g(QD,T), 30, need not be located on the same card as the ER algorithm, 28. The result of g(QD,T), 30, could be sent in a special RM cell that is extracted from the cell stream by the ER algorithm, 28. This is an important application of the invention because the generation of g(QD,T) can be achieved very inexpensively. Thus the ER calculation can be distributed between a card with scarce resources and a card with less strict resource constraints. Alternatively the update of OBW(k) may be given by,

[0047] OBW(k)=OBW(k−1)+g(QD,T)

[0048] where the function g(QD,T) takes the form

[0049] g(QD,T)=G×(T−QD)

[0050] where G is a configurable parameter and provides a gain on the feedback. This form provides a linear proportional control of the queue size.

[0051] An event triggers the calculation of the offered cell rate, OCRi, 32, for a particular connection by the ER algorithm 28. This event may be internally scheduled, or generated by the arrival of a forward RM cell for the connection. The offered cell rate, OCR_ifor connection, i, is given by,

[0052] OCR_i=min[PCR_i, (MCR_i+(W_i×OBW(k)))].

[0053] The backward RM cell, 34, contains a field which holds the explicit rate for a connection. If the OCRi, 32, is less than the value in the ER field of the backward RM cell, 34, then the value of OCRi, 32, is written into the ER field of the backward RM cell, 34. That is

[0054] BERi=min(BERi, OCRi)

[0055] The RM cell is transmitted to the ABR source (not shown) via the backward cell flow, 36. At the ABR source the outflow rate of ABR cells is controlled in accordance with the ER information contained in the backward cell.

[0056] While a particular embodiment of the invention has been described and illustrated it will be apparent to one skilled in the art that various alternatives to this embodiment can be implemented. It is to be understood that such alterations will come within the scope of the present invention as defined in the attached claims.