Method and system in an asynchronous transfer mode (ATM) network for providing an available bit rate interface to a continuous bit rate virtual path connection with adjustable bandwidth

[0002] The present invention relates to Asynchronous Transfer Mode (ATM) networks, and more particularly to a method and system for providing an Available Bit Rate (ABR) interface to a non ATM bandwidth adjustable Virtual Path Connection (CBR VPC).

[0003] High Speed Communication Networks

[0004] In modern telecommunication networks, different types of applications must share the same transmission media, and networks equipment must be able to support these different services while guaranteeing to each of them a specified quality of service. While some years ago, voice and data used separate networks, they now share bandwidth of the same links. For the last three years, standards organizations have worked to define transmission modes, such as ATM (Asynchronous Transmission Mode), Frame Relay, and so forth, and inside a particular transmission mode, to specify in detail the services provided to network applications. For ATM, for instance, four different service categories exist, and a user will choose one of them based on the type of service required:

[0005] Continuous Bit Rate (CBR)

[0006] This service is intended for uncompressed voice, and highest priority applications (video). The cost of this service is the highest because the bandwidth which is reserved corresponds to the maximum rate (Peak Cell Rate PCR) at which this type of application can emit. This is the bandwidth to allocate when the quality of service, in terms of maximum Cell Transfer Delay (maxCTD) and Peak to peak Cell Delay Variation (peak to peak CDV), must be guaranteed whatever the network load conditions.

[0007] Variable Bit Rate (VBR)

[0008] This service is a compromise between the Continuous Bit Rate (CBR), which requires a lot of resources, and a service where no reservation of bandwidth would be done. Effectively here, a bandwidth comprised between the Sustainable Cell Rate (SCR) of the connection and the Peak Cell Rate (PCR) of the connection is allocated, depending on the burstiness of the traffic. When the bursts created by the application in the network are limited, a bandwidth close to the Sustainable Cell Rate (SCR) is reserved. When the bursts induced by the application are large (or may be large), a bandwidth closer to the Peak Cell Rate is reserved to avoid overloading links and buffers, and loss of data.

[0009] While the service offered here also guarantees a very low loss of packets or cells (Cell Loss Ratio CLR), the transfer delays and cell delay variations are more important than for CBR. In general, VBR can be divided into VBR Real Time (good candidate for video and data RT applications) and VBR Non Real Time (good candidate for data sensitive traffic).

[0010] Unspecified Bit Rate (UBR)

[0011] This service is totally uncontrolled. Traffic is sent in the network, and is transmitted provided that the network is not congested. When the network is congested, cells are discarded. Unlike CBR and VBR, no quality of service can be guaranteed.

[0012] Available Bit Rate (ABR)

[0013] This service provides again less quality than Variable Bit Rate (VBR), and can be used for different applications. While a minimum reservation can be done in the network to guarantee to an application a “worst case” behavior, the steady state behavior of the service offered corresponds to a “non reserved” type of service, where nearly no resource is allocated in the network. When congestion occurs, feedback is conveyed through the network back to the traffic sources to prevent them from sending more data. This reactive system behavior is directly linked to the network size. The delay to convey back congestion information to the sources increases as a function of the network size, and may nevertheless induce losses. In this case, end users make decisions to send the data again. Here neither the delays nor the losses can be guaranteed; the service is only assumed to minimize the losses.

[0014] All these different services are proposed and used simultaneously in most networks.

[0015] Bandwidth Optimization

[0016] Most wide-area ATM networks (large country, world-wide networks) are configured so that an ATM backbone network can support communications between different ATM access networks. Such network topology allows good performance and the optimization of the network administration. Generally, the backbone network is a public ATM network, and access networks are private ATM networks. However, the backbone can be used within a single private network using, for example, lines leased from a carrier. To optimize the resources where they are most demanded, in particular the bandwidth within the backbone network, several solutions can be implemented, all taking into account the dynamic availability of the bandwidth:

[0017] 1. End to End Available Bit Rate Virtual Channel Connections (ABR VCCs) for Data Traffic

[0018] This solution, as illustrated in FIG. 5, supposes the support of ABR VCCs by all end-systems (source node 1 and destination node 8). The advantage is that intermediate nodes within access networks and within the backbone network (nodes 2 to 7) have only to set an Explicit Forward Congestion Indication (EFCI) bit in the ATM cells to be compliant with the ATM Forum recommendation (ATM Forum—Technical Committee—“Traffic Management Specification,” version 4.0, April 96, paragraph 5.10.6, rule 1.a)). End-systems (nodes 1 and 8) connected to users (user 1 and user 2) do the most complex process, in particular:

[0019] the ABR source behavior (node 1) including:

[0020] generation of Resource Management cells (RM-cells),

[0021] insertion of RM-cells in the traffic,

[0022] computation of a transmission rate per VCC based on congestion information received from RM-cells,

[0023] dynamic traffic shaping, and

[0024] the ABR destination (node 8) behavior including:

[0025] transmission of RM-cells back to the source in response to forward RM-cells,

[0026] setting of the congestion fields within RM-cells, and

[0027] insertion of RM-cells in the traffic.

[0028] A more sophisticated implementation of the Available Bit Rate (ABR) category of service in intermediate nodes is described in the ATM Forum paragraph 5.10.6, rule 1.c). The so called “switch behavior” allows the control of congestion at queuing points, and in particular the modification of the Explicit Rate (ER) field within RM-cells for a better response to congestion and thus a lower cell loss.

[0029] 2. Available Bit Rate Virtual Path Connections (ABR VPCs) in the Backbone

[0030] FIG. 6 is a view of a network comprising a first access network (access network 1) comprising an end node (node 1) connected to a user (user 1) and a source node (source node 2), a backbone network comprising a plurality of nodes (node 3, node 4, and node 9) and a second access network (access network 2) comprising a destination node (destination node 5), transit nodes (nodes 6 and 7), and an end node (node 8) connected to a user 2. An ABR VCC is established between nodes 2-5, to transmit, to node 5, traffic of end user 1 (VCC1) together with traffic of other end users (VCC3). In node 5, traffic is discriminated according to its destination, and transmitted to end user 2 (VCC2) and to other end users (VCC4).

[0031] ABR Virtual Path Connections (VPCs), as illustrated in FIG. 6, are set up in the backbone network for interconnecting access networks (access networks 1 and 2). The nodes within the access networks directly connected to the backbone network (nodes 2 and 5) use these ABR VPCs to transport VCCs (VCC1, VCC3). In order to comply with the ATM Forum recommendations (paragraph 5.10.9), these nodes implement the ABR source and destination behavior as described in paragraphs 5.10.4 to 5.10.9. Access nodes (nodes 2 and 5) must also be able to provide a fair share of the bandwidth of these Virtual Path Connections (VPCs) among the different Virtual Channel Connections (VCC1, VCC3) they support.

[0032] 3. Continuous Bit Rate Virtual Path Connections (CBR VPCs) with Adjustable Bandwidth in the Backbone

[0033] FIG. 7 is a view of a network comprising a first access network (access network 1) comprising an end node (node 1) connected to a user 1 and a source node (source node 2), a backbone network comprising a plurality of nodes (nodes 3, 4, and 9) and a second access network (access network 2) comprising a destination node (destination node 5), transit nodes (nodes 6 and 7), and an end node (node 8) connected to a user 2. A CBR VCC is established between nodes 2-5, to transmit, to node 5, traffic of end user 1 (VCC1) together with traffic of other end users (VCC3). In node 5, traffic is discriminated according to its destination, and transmitted to end user 2 (VCC2) and to other end users (VCC4).

[0034] A bandwidth adjustable CBR Virtual Path Connection (VPC), as illustrated in FIG. 7, is set up in the backbone network for interconnecting the access networks (access networks 1 and 2). The nodes within the access networks directly connected to the backbone network (nodes 2 and 5) use this CBR VPC to transport VCCs. Access nodes must provide a fair share of the bandwidth of this CBR Virtual Path Connection (VPC) among the different Virtual Channel Connections (VCC1, VCC3) it supports.

[0035] This last solution implies a dynamic adjustment of the CBR VPC bandwidth according to the network availability. Each time the bandwidth of a CBR connection is modified, the Connection Admission Control (CAC) process is triggered. However, because this process requires a large amount of resources, it cannot be processed continuously. A certain degree of integration is necessary to manage the fluctuations of the network load. The response time required to adjust the bandwidth of a CBR VPC is not in the order of a millisecond, as for an ABR VPC, but in the order of a minute or more depending upon the number of voice connections established and disconnected within a given time period.

[0036] Bandwidth Adjustable Virtual Path Connections

[0037] The establishment of dynamic bandwidth adjustable Virtual Paths Connections (ABR or CBR VPCs) as shown in solutions 2 and 3 allows the aggregation of multiple VCCs and thus better management of the bandwidth within the backbone network.

[0038] VCC Aggregation

[0039] While most Virtual Channel Connections (VCCs) within access networks do not require a large amount of bandwidth, the traffic between the different access networks through the backbone network requires the definition of large bandwidth connections. The use of Virtual Path Connections (VPCs) considerably limits the number of VCCs which must be established on the backbone network, while optimizing the bandwidth utilization. The response time is generally reduced, avoiding delays in the different policing processes. While in access networks CBR, VBR or ABR/UBR Virtual Channel Connections (VCCs) are established, the backbone network requires usually ABR or CBR VPCs. These Virtual Path Connections must be able to transport any category of service, without distinction of quality, through the backbone network.

[0040] Bandwidth Management

[0041] The quality of the process used at the backbone/access networks edges to allocate the bandwidth of a VPC among different individual VCC connections determines the overall performance of the end to end service: short delays for high priority traffic (voice or CBR traffic), and smoothing of low priority traffic (data or ABR traffic) even if, within the backbone network, in the same Virtual Path Connection (VPC), all types of traffic are mixed. The different functions of the process for controlling the traffic are smoothing, queuing, and bandwidth allocation.

[0042] Smoothing: a shaping function is used to send the traffic of the Virtual Channel Connections (VCCs) on the Virtual Path Connection (VPC), controlling the maximum transmission rate. Delays between consecutive cells are introduced to space the flow.

[0043] Queuing: the shaping function lets the traffic leave the node at a lower rate than available. This induces additional queuing in the node. A good implementation allows the storing of data without loss.

[0044] Bandwidth Allocation: within a given Virtual Path Connection (VPC), the bandwidth is allocated among the different VCC connections. Rules must be chosen to fairly allocate the bandwidth of a Virtual Path Connection (VPC) taking into account the category of service of the different VCCs (CBR, VBR, ABR, UBR).

[0045] ABR and Bandwidth Adjustable CBR Virtual Path Connections (VPC)

[0046] ABR Virtual Path Connections (FIG. 6)

[0047] While the Available Bit Rate (ABR) service category is defined in the ATM Forum specifications and provides an efficient bandwidth utilization, its implementation requires important resources in term of:

[0048] processing capacity for managing RM-cells along the ABR VPC and continuously (in a time period on the order of a micro or milli second) adjusting the bandwidth, and

[0049] additional bandwidth. Per default, one RM-cell is generated every 32 cells, which represents about 3% additional bandwidth only used for the RM-cell traffic.

[0050] Solutions based on equivalent principles (dynamic bandwidth adjustment function of the network availability), but characterized by a slower reaction time (minutes or seconds instead of microseconds) are then preferred to ABR service category to save resources.

[0051] Bandwidth Adjustable CBR Virtual Path Connection (FIG. 7)

[0052] The ATM specifications defined in the ATM Forum do not define a bandwidth adjustable CBR or VPC. This service category is not standard and its implementation depends on the backbone network provider. As illustrated in FIG. 7, when both access network and backbone network are managed by the same network provider, it is possible to define a specific (proprietary) solution for transporting the adjustment information including the VPC transmission rate from the backbone network to the access network. In this case, proprietary RM-cells can be used at the interface between access network and backbone network (between node 2 and node 3). If access and backbone networks are not managed by the same provider, only a standard interface can be used.

[0053] FIG. 8 is a view of a network comprising a first access network (access network 1) comprising an end node (node 1) connected to a user 1 and a source node (node 2), a backbone network comprising a plurality of nodes (nodes 3, 4, and 9), and a second access network (access network 2) comprising a destination node (node 5), transit nodes (nodes 6 and 7), and an end node (node 8) connected to a user 2. A CBR VCC is established in the backbone network between nodes 3 and 4, to transmit, to node 4, traffic of end user 1 (VCC1).

[0054] The solution according to the present invention is, as shown in FIG. 8, to configure an Available Bit Rate (ABR) Virtual Path Connection (VPC) between nodes 2 and 3 in order to provide this standard interface to the proprietary CBR VPC established in the backbone network. Node 2 will see an ABR VPC, and will react as if an end to end ABR VPC were set-up. In the backbone network, node 3 at the destination of the ABR VPC and at the source of the adjustable CBR VPC, will be in charge of translating the CBR VPC bandwidth adjustments into RM-cells updates on the ABR VPC.

[0055] Similarly, an Available Bit Rate (ABR) Virtual Path Connection (VPC) is also configured between nodes 4 and 5 to provide a standard interface to the proprietary CBR VCC established in the backbone network between nodes 3 and 4. In node 5, the traffic is transmitted to end user 2 (VCC2).

[0056] The object of the present invention is to provide to an ATM access network a standard and transparent ATM interface for accessing a non standard ATM bandwidth adjustable virtual path connection established on a backbone network between a backbone source node and a backbone destination node, this backbone network and this ATM access network comprising a plurality of nodes interconnected with transmission links. An ATM available bit rate (ABR) virtual path connection is established between the ATM access network and the backbone source node of the bandwidth adjustable virtual path connection. The available bit rate is adjusted according to the adjusted bandwidth of the virtual path connection established on the backbone node.

[0057] In a particular embodiment, the bandwidth adjustable virtual path connection is a continuous bit rate (CBR) virtual path connection with dynamic bandwidth adjustment. The backbone network comprises a bandwidth management server connected to each backbone node first, for dynamically computing the bandwidth which is available on backbone transmission links, second, for sharing this bandwidth among the bandwidth adjustable virtual path connections established on the backbone network, third, for balancing among the backbone transmission links, the bandwidth reserved for bandwidth adjustable virtual path connections, and finally for adjusting the bandwidth of these bandwidth adjustable virtual path connections through the respective source nodes.

[0058] The novel and inventive features believed characteristics of the invention are set forth in the appended claims. The invention itself, however, as well as a preferred mode of use, further objects and advantages thereof, will best be understood by reference to the following detailed description of an illustrative detailed embodiment when read in conjunction with the accompanying drawings, wherein:

[0059] FIG. 1 is an overview of an ATM network.

[0060] FIG. 2 illustrates the routing concept in an ATM network.

[0061] FIG. 3 summarizes the relationship between links, VPs and VCs in an ATM network.

[0062] FIG. 4 is an example of a source to destination ABR control loop according to the ATM Forum.

[0063] FIG. 5 illustrates the establishment of an end to end Available Bit Rate Virtual Channel Connection (ABR VCC) between a source end system and a destination end-system.

[0064] FIG. 6 illustrates the establishment of an Available Bit Rate Virtual Path Connection (ABR VPC) on the backbone network.

[0065] FIG. 7 illustrates the establishment of a Continuous Bit Rate Virtual Path Connection (CBR VPC) with dynamic bandwidth allocation on the backbone network.

[0066] FIG. 8 illustrates the establishment of an ABR Virtual Path between access network and backbone network for interfacing a bandwidth adjustable CBR in the backbone network.

[0067] FIG. 9 shows the establishment of Virtual Path and Virtual Channel Connections through respectively the backbone and access networks.

[0068] FIG. 10 shows how the access networks and the backbone network interface together to manage an ABR Virtual Path (VP) established on the backbone network.

[0069] FIG. 11 sows how the access networks and the backbone network interface together for managing a CBR Virtual Path (VP) set-up on the backbone network.

[0070] FIG. 12 shows the different types of Virtual Channel Connections (VCCs) that can be supported according to the present invention by an ABR or CBR Virtual Path established on the ATM backbone network.

[0071] FIG. 13 describes the bandwidth adjustment mechanism and in particular the relationship within a given adapter between the receive part which receives the backward RM-cells, the Virtual Path Connection Manager which computes the VPC transmission rate and the transmit part which sends the shaped traffic on the ABR or CBR Virtual Path Connection (VPC).

[0072] FIG. 14 is a general view of the Virtual Path Connection Table (VPCT).

[0073] FIG. 15 is a flow chart of the bandwidth sharing process.

[0074] FIG. 16 shows the bandwidth adjustment of an ABR or CBR Virtual Path Connection (VPC) established in a backbone link in accordance with the variation of the voice traffic.

[0075] FIG. 17 is a general view of an ATM network comprising a backbone network with a plurality of access networks.

[0076] FIG. 18 shows a Continuous Bit Rate (CBR) Virtual Path Connection (VPC) in a backbone network controlled by a Bandwidth Management Server.

[0077] FIG. 19 is a flow chart of the method for dynamically adjusting the bandwidth of a Continuous Bit Rate (CBR) Virtual Path Connection (VPC).

[0078] Asynchronous Transfer Mode (ATM)

[0079] Asynchronous Transfer Mode (ATM) is a new telecommunication technology developed by the telecommunications (carrier) industry for both data transmissions (computer) and telecommunications (telephone). This is conceived as a carrier service to provide high speed communications to end users in an integrated way. The key concepts of ATM are as follows:

[0080] Cells: all information (voice, image, video, data) is transported through the network in very short, fixed length (48 data bytes plus a 5-byte header) blocks called “cells”. The ATM cell size was defined as a compromise between voice and data requirements.

[0081] Routing: information flow along paths (called “Virtual Channels” VC) is set up as a series of pointers through the network. The cell header contains an identifier that links the cell to the correct path for it to take towards its destination. Cells on a particular virtual channel always follow the same path through the network and are delivered to the destination in the same order in which they are received.

[0082] Hardware-Based Switching: ATM is designed so that simple hardware based logic elements may be employed at each node to perform the switching.

[0083] Adaptation: at the edges of the network user data frames are broken up into cells. Continuous data streams such as voice and video are assembled into cells. At the destination side of the network the user data frames are reconstructed from the received cells and returned to the end user in the form (data frames etc.) that they were delivered to the network. This adaptation function is considered part of the network but is in a higher layer function, which is called the ATM Adaptation Layer (AAL).

[0084] Error Control: the ATM cell switching network only checks cell headers for errors and simply discards cells in error.

[0085] Flow Control: an ATM network has no internal flow control of any kind. Instead ATM has a set of input rate controls that limit the rate of traffic delivered to the network.

[0086] Congestion Control: there is only one thing an ATM network can do when a link or node becomes congested: cells are discarded until the problem has been relieved. Some (lower-priority) cells can be marked such that they are the first to be discarded in the case of congestion. Connection endpoints are not notified when cells are discarded. It is up to the adaptation function or higher-layer protocols to detect and recover from the loss of cells (if necessary and possible).

[0087] Additional information concerning ATM networks can found in the publication entitled “Asynchronous Transfer Mode Broad band ISDN) Technical Overview”, IBM International Technical Support Centers, October 1995, SG24-4625-00.

[0088] Structure of ATM Networks

[0089] The conceptual structure of an ATM network is shown in FIG. 1.

[0090] ATM Networks: FIG. 1 shows three quite separate ATM networks—two private and one public. Private ATM networks are sometimes called “Customer Premises Networks”.

[0091] ATM Switches: Four “ATM Switches” or “ATM nodes” are shown in FIG. 1. These perform the backbone data transport with the ATM network.

[0092] ATM End point: The ATM end point is a piece of end user equipment that interfaces to an ATM network in a native way. An end point sends and receives ATM cells on link connections defined by ATM standards. An end point (and only an end point) contains an ATM Adaptation Layer (AAL) function. An ATM end point connects to the ATM network over the User Network Interface (UNI).

[0093] User Network Interface (UNI): The UNI is specified exactly by the applicable standards. The public UNI is for connection of end-user equipment to a public ATM network. The private UNI is for use within a single organization's premises or for a private network using lines leased from a carrier such as the PTT.

[0094] Network Node Interface (NNI): This is the trunk connection between two Network Nodes (NNs). NNI allows the connection of different ATM nodes.

[0095] Links: there may be one or many physical link connections between the nodes. Links between nodes may be carried as “clear channel” such as over a direct point-to-point connection but may also be carried over a Sonet/SDH connection or over a PDH connection.

[0096] ATM Adaptation Layers: End users of an ATM network will be of two kinds:

[0097] those that interface to the ATM network directly through either the public UNI or a private UNI, and those that do not know anything about ATM and interface using a non-ATM protocol (such as Frame Relay, voice, constant bit rate)).

[0098] For all types of users there are common tasks that must be performed in order to connect to the ATM network. In its definition ATM includes processing for these common tasks. This is called the ATM Adaptation Layer (AAL). The AAL is the real end-user interface to ATM.

[0099] Virtual Channels and Virtual Routes

[0100] Some of the key concepts in ATM are those relating to how data is routed through the network. FIG. 2 illustrates these concepts:

[0101] Virtual Path (VP): As illustrated in FIG. 2, a VP (VP1, VP2, VP3, VP5, VP8) is a route through the network representing a group of virtual channels (VCs). VPs may exist between ATM end points, as between CPN1 and CPN2 (VP2, VP3 over link1/link1) and between CPN2 and CPN3 (VP2, VP3); ATM nodes and ATM end points as between NN1 and CPN1 (VP2 and VP5 over link1/link 1), NN 1 and CPN2 (VP3 and VP8 over link2/link1, and VP3 over link3/link2), and NN2 and CPN3 (VP2 over link2/link1 and VP1 over link3/link2); and ATM nodes as between NN1 and NN 2 (VP3 and VP5 over link4/link1).

[0102] A VP may be routed through an ATM node by reference only to the VP number, or it may terminate in an ATM node. A VP entering an end point always terminates in that end point. The concepts of Virtual Path (VP) and Virtual Path Connection (VPC) will be considered as identical in the present description.

[0103] Virtual Channel (VC): The concept of a virtual channel is defined in ATM as a unidirectional connection between end users. In the example of FIG. 2, VC8 is defined between CPN1 and CPN2, VC11 is defined between CPN1 and CPN2, VC11 in NN1 is swapped to VC7 to go to NN2, VC21/VC2 are defined between CPN1 and CPN2, VC21 in NN1 is swapped to VC2 to go to CPN2, VC11/VC9 are defined between CPN1 and CPN3, and VC2 is defined between CPN2 and CPN3.

[0104] Virtual Channel Connection (VCC): A Virtual Channel Connection is the end-to-end connection along which a user sends data. While a VCC is defined to be unidirectional, it must be noted that VCCs always occur in pairs, one VCC in each direction. Thus a bi-directional communication channel includes a pair of VCCs (that have to follow the same physical path through the network).

[0105] The concepts of VC and VCC are likewise almost the same. The acronym VC is most often used in a generic context and VCC in much more specific ways.

[0106] Virtual Channel Link (VCL): A Virtual Channel Link is a separately identified data flow within a link or a virtual path. A Virtual Channel Connection (VCC) through the network is a sequence of interconnected (concatenated) VCLs.

[0107] The relationship between physical links, VPs and VCs is summarized in FIG. 3:

[0108] VPs within links: Within each link there are a number of VPs. The maximum number is defined by the number of bits allocated of Virtual Path Identifiers (VPIs) within the ATM cell header.

[0109] VCs within VPs: Each VP has a number of VCs within it. The maximum number is restricted by the number of bits allocated to Virtual Channel Identifiers (VCIs) within the cell header.

[0110] As far as the architecture of ATM is concerned, each link may have all possible VPs and each VP may have all possible VCs within it.

[0111] Each Virtual Connection has a given Quality of Service (QoS) characteristic associated with it. This quality of service specifies an average bandwidth as well as a maximum peak (instantaneous) allowed bandwidth. In serious overload situations, when the network cannot recover from overload by discarding only cells marked as low priority, the network can select which cells to discard depending on the quality of service characteristic on the VC. A VP also has a quality of service associated with it. VCs within a VP may have a lower quality of service than the VP but they cannot have a higher one.

[0112] ATM Services

[0113] ATM (Asynchronous Transfer Mode) technology is intended to support a wide variety of services and applications. The control of ATM network traffic is fundamentally related to the ability of the network to provide appropriately differentiated quality of service for network applications. ATM specifications define procedures and parameters related to traffic management and quality of service. A primary role for traffic management is to protect the network and the end-system from congestion in order to achieve network performance objectives. An additional role is to promote the efficient use of network resources.

[0114] Five service categories are specified. For each one, a set of parameters is given to describe both the traffic presented to the network, and the quality of service which is required of the network. A number of traffic control mechanisms are defined, which the network may utilize to meet the quality of service objectives.

[0115] As described in the ATM Forum—Technical Committee—“Traffic Management Specification”; Version 4.0 April 1996, the architecture for services provided at the ATM layer consists of the following service categories:

[0116] CBR: Constant Bit Rate

[0117] VBR: real-time/non-real-time Variable Bit Rate

[0118] UBR: Unspecified Bit Rate

[0119] ABR: Available Bit Rate

[0120] These service categories relate traffic characteristics and quality of service requirements to network behavior. Functions such as routing, Connection Admission Control (CAC), and resource allocation are, in general, structured differently for each service category. Service categories are distinguished as being either real-time (CBR and RT-VBR) or non-real time (NRT-VBR, UBR, ABR). For real-time traffic, there are two categories, CBR and real-time VBR, distinguished by whether the traffic descriptor contains only the Peak Cell Rate (PCR) or both PCR and the Sustainable Cell Rate (SCR). All service categories apply to both Virtual Channel Connections (VCCs) and Virtual Path Connections (VPCs). Throughout the present description, the term “connection” refers to either VCCs or VPCs.

[0121] The ATM layer quality of service (QoS) is measured by a set of parameters characterizing the performance of an ATM layer connection:

[0122] 1. Peak to peak Cell Delay Variation (peak to peak CDV)

[0123] 2. Maximum Cell Transfer Delay (maxCTD)

[0124] 3. Cell Loss Ratio (CLR)

[0125] These quality of service parameters quantify end to end network performance at the ATM layer. Each of the following service categories has one or more conformance definitions distinguished by the manner in which the quality of service parameters apply to the cell flows.

[0126] Constant Bit Rate (CBR) Service

[0127] The Constant Bit Rate service category is used by connections that request a static amount of bandwidth that is continuously available during the connection lifetime. This amount of bandwidth is characterized by a Peak Cell Rate (PCR) value.

[0128] The basic commitment made by the network to a user who reserves resources via the CBR capability is that once the connection is established, the negotiated ATM layer quality of service is assured to all cells when all cells are conforming to the relevant conformance tests. In the CBR capability, the source can emit cells at the Peak Cell Rate at any time and for any duration; the quality of service still pertains.

[0129] CBR service is intended to support real-time applications requiring tightly constrained delay variation (e.g., voice, video, circuit emulation) but is not restricted to these applications. In the CBR capability, the source may emit cells at, or below the negotiated Peak Cell Rate (and may also even be silent), for periods of time. Cells which are delayed beyond the value specified by the maximum cell transfer delay (maxCTD) are assumed to be significantly reduced in value to the application. The CBR service category may be used for both VPCs (Virtual Path Connections) and VCCs (Virtual Channel Connections).

[0130] Real-Time Variable Bit Rate (RT-VBR) Service

[0131] The real-time VBR service category is intended for real-time applications, i.e., those requiring tightly constrained delay and delay variation, as would be appropriate for voice and video applications. RT-VBR connections are characterized in terms of a Peak Cell Rate (PCR), Sustainable Cell Rate (SCR), and Maximum Burst Size (MBS). Sources are expected to transmit at a rate which varies with time. Equivalently the source can be described as “bursty”. Cells that are delayed beyond the value specified by maxCTD are assumed to be of significantly reduced value to the application. Real-time VBR service may support statistical multiplexing of real-time sources.

[0132] Non-Real-Time Variable Bit Rate (NRT-VBR) Service

[0133] The non-real-time VBR service category is intended for non-real-time applications which have bursty traffic characteristics and which are characterized in terms of a Peak Cell Rate (PCR), Sustainable Cell Rate (SCR), and Maximum Burst size (MBS). For those cells which are transferred within the traffic contract, the application expects a low cell loss ratio. Non-real-time VBR service may support statistical multiplexing of connections. No delay bounds are associated with this service category.

[0134] Unspecified Bit Rate (UBR) Service

[0135] The Unspecified Bit Rate (UBR) service category is intended for non-real-time applications, i.e., those not requiring tightly constrained delay and delay variation. Examples of such applications are traditional computer communications applications, such as file transfer and email.

[0136] UBR service does not specify traffic related service guarantees. No numerical commitments are made with respect to the Cell Loss Ratio (CLR) experienced by a UBR connection, or as to the Cell Transfer Delay (CTD) experienced by cells on the connection. A network may or may not apply Peak Cell Rate to the Connection Admission Control (CAC) and Usage Parameter Control (UPC) functions. In the case where the network does not enforce Peak Cell Rate (PCR), the value of Peak Cell Rate is informational only. When Peak Cell Rate is not enforced it is still useful to have Peak Cell Rate (PCR) negotiated, since this may allow the source to discover the smallest bandwidth limitation along the path of the connection. Congestion control for UBR may be performed at a higher layer on an end to end basis. The UBR service is indicated by use of the Best Effort Indicator in the ATM User Cell Rate Information Element.

[0137] Available Bit Rate (ABR) Service

[0138] ABR is an ATM layer service category for which the limiting ATM layer transfer characteristics provided by the network may change subsequent to connection establishment. A flow control mechanism supports several types of feedback to control the source rate in response to changing ATM layer transfer characteristics. This feedback is conveyed to the source through specific control cells called Resource Management cells, or RM-cells. It is expected that an end-system that adapts its traffic in accordance with the feedback will experience a low cell loss ratio and obtain a fair share of the available bandwidth according to a network specific allocation policy. The ABR service does not require bounding the delay or the delay variation experienced by a given connection. ABR service is not intended to support real-time applications.

[0139] On the establishment of an ABR connection, the end-system shall specify to the network both a maximum required bandwidth and a minimum usable bandwidth. These shall be designated as Peak Cell Rate (PCR), and the Minimum Cell Rate (MCR) respectively. The MCR may be specified as zero. The bandwidth available from the network may vary, but shall not become less than the Minimum Cell Rate (MCR).

[0140] Generic Control Functions

[0141] The following functions are defined for managing and controlling traffic and congestion in ATM networks and may be used in appropriate combinations depending on the service category:

[0142] Connection Admission Control (CAC) is defined as the set of actions taken by the network during the call set up phase in order to determine whether a connection request can be accepted or should be rejected (or whether a request for reallocation can be accommodated). Based on the CAC function, a connection request is processed only when sufficient resources are available at each successive network element to establish the connection through the whole network based on its service category, traffic contract, and quality of service, and in order to maintain the agreed quality of service of existing connections.

[0143] Feedback controls are defined as the set of actions taken by the network and by end systems to regulate the traffic submitted on ATM connections according to the state of the network.

[0144] Usage Parameter Control (UPC) is defined as the set of actions taken by the network to monitor and control traffic, in terms of traffic offered and validity of the ATM connection, at the end system access.

[0145] Traffic shaping may be used to achieve a desired modification of the traffic characteristics. Traffic shaping is a mechanism that alters the traffic characteristics of a stream of cells on a connection to achieve better efficiency whilst meeting the quality of services objectives, or to ensure conformance at a subsequent interface. Examples of traffic shaping are peak cell rate reduction, burst length limiting, reduction of Cell Delay Variation (CDV) by suitably spacing cells in time, and cell scheduling policy.

[0146] Explicit Forward Congestion Indication (EFCI) may be set by a network element in an impending congested state or a congested state in the cell header so that this indication may be examined by the destination end system. For example the end system may use this indication to implement a protocol that adaptively lowers the cell rate of the connection during congestion or impending congestion. A network element that is not in a congested state or an impending congested state will not modify the value of this indication. An impending congested state is the state when a network element is operating around its engineered capacity level.

[0147] ABR Flow Control protocol may be used to adaptively share the available bandwidth among participating users. In the ABR service, the source adapts its rate to changing conditions. Information about the state of the network like bandwidth availability, state of congestion, and impending congestion, is conveyed to the source through special control cells called Resource Management Cells (RM-cells).

[0148] Available Bit Rate Service Category (ABR)

[0149] Nature of the Service Guarantees

[0150] The ABR service category provides a low cell loss ratio for those connections whose end-stations obey a specified reference behavior. No numeric commitment is made about cell transfer delay. If the end points fail to observe the reference behavior, the cell loss ratio is not guaranteed. Fairness among connections is assumed, modified by the MCR (Minimum Cell Rate), local policy in network elements, and a potentially significant error term.

[0151] Mechanism

[0152] The ABR service is inherently closed loop. The source performs dynamic traffic shaping based on feedback received from the network. This behavior may be enforced by the network using Usage Parameter Control (UPC). A Minimum Cell Rate (MCR) is negotiated. If the MCR is non zero, then it is assumed that resources are reserved in network nodes to ensure that the feedback never causes the available cell rate to fall below the MCR, and that low Cell Loss Ratio (CLR) is achieved; thus, Connection Admission Control (CAC) is provided in the network. Local policy in network elements contributes to fairness and isolation, with the objective of achieving low Cell Loss ratio (CLR) for those connections which obey the source behavior.

[0153] Flow Control Model

[0154] ABR flow control occurs between a sending end system (source) and a receiving end system (destination). Sources and destinations are connected via bi-directional connections. For a bi-directional ABR connection, each connection termination point is both a source and a destination. For the sake of simplicity, only the information flow from the source to the destination with its associated Resource Management cell (RM-cell) flows is considered. The forward direction is the direction from the source to the destination, and the backward direction is the direction from the destination to the source. As shown in FIG. 4, for the forward information flow from the end system source (S) to the end system destination (D) through network elements (NE), there is a control loop consisting of two RM-cell flows, one in the forward direction and one in the backward. The source (S) associated with this forward information flow generates forward RM-cells which are turned around by the destination (D) and sent back to the source as backward RM-cells. These backward RM-cells carry feedback information provided by the network elements (NE) and/or the destination back to the source.

[0155] A network element/node (NE) may:

[0156] Directly insert feedback control information into RM-cells when they pass in the forward or backward direction.

[0157] Indirectly inform the source about congestion by setting the EFCI bit in the data cell header of the cells of the forward information flow. In this case, the destination will update the backward RM-cells based on this congestion information.

[0158] Generate backward RM-cells.

[0159] RM-Cell Fields

[0160] A Resource Management cell comprises, in particular, the following fields:

[0161] Header: standard ATM header.

[0162] ID: the protocol ID identifies the service using the RM-cell.

[0163] Message Type:

[0164] DIR: the DIR (Direction) field indicates the direction (forward or backward) of data flow as associated with the RM-cell.

[0165] BN: the BN field indicates whether the RM-cell is a Backward Explicit Congestion Notification (BECN) cell or not.

[0166] CI: the CI (Congestion Indication) field allows a network element to indicate that there is congestion in the network.

[0167] NI: the NI (No Increase) field is used to prevent a source from increasing its Allowable Cell Rate (ACR).

[0168] ER: the ER (Explicit Rate) field is used to limit the source ACR (Allowed Cell Rate) to a specific value. For each RM-cell, ER is set by the source to a requested rate (such as PCR—Peak Cell Rate). It may be subsequently reduced by any network element in the path to a value that the element can sustain.

[0169] CCR: the CCR (Current Cell Rate) field is set by the source to its current ACR.

[0170] MCR: the MCR (Minimum Cell Rate) field carries the connection's Minimum Cell rate. It may be useful to network elements in allocating bandwidth among connections.

[0171] Backbone and Access Networks

[0172] FIG. 17 is a general view of an ATM network comprising an ATM backbone network comprising a plurality of nodes (nodes 3, 4, 9) connected over the NNI to a plurality of ATM access networks (access networks 1, 2, 3, 4, 5), each ATM access network comprising a plurality of nodes (nodes 1, 2, 5, 6, 7, 8) including one or a plurality of source nodes (node 1) and/or destination nodes (node 8) connected to one or several end users (users 1, 2) over the UNI. Generally, ATM access networks are private ATM networks called “customer premises networks” and indeed they are very often confined to a local area such as a building or a campus. However, a private ATM network can be distributed over a wide area by the use of carrier (non-ATM) links between ATM nodes. The ATM backbone network is generally a public ATM network but can also be part of a private ATM network using lines leased from a carrier such as the PTT.

[0173] FIG. 9 shows the establishment of a Virtual Path Connection and Virtual Channel Connections through respectively the backbone (nodes 3 and 6) and the source (nodes 1 and 2) and destination (nodes 5 and 8) access networks according to the present invention. When end user 1 wants to communicate with end user 2:

[0174] A Virtual Channel Connection (VCC1) is established from user 1 to node 2.

[0175] A bandwidth adjustable Virtual Path Connection (VPC) is established between access nodes 2 and 5 within the backbone network. This Virtual Path Connection (VPC) transmits, to node 5, the traffic of end user 1 together with the traffic of several other end users (VCC3 . . . ).

[0176] In node 5, the traffic is discriminated according to its destination. The traffic generated by end user 1 is transmitted through a Virtual Channel Connection VCC2 from node 5 to end user 2.

[0177] Available Bit Rate Virtual Path Connection (ABR VPC)

[0178] FIG. 10 shows how ATM access networks (source access network 1 and destination access network 2) and the ATM backbone network communicate together using RM-cells in the context of an ABR VPC set-up in the backbone network.

[0179] 1. An Available Bit Rate Virtual Path Connection (ABR VPC) is set up between the end node (node 2) of the source access network (access network 1) and the end node (node 5) of the destination access network (access network 2).

[0180] 2. The origin node of the ABR VPC (node 2: end node of the ATM access network) generates Resource Management cells (RM-cells) and sends them to the first node of the destination access network (node 5) through the backbone network (via nodes 3 and node 4).

[0181] 3. This access node (node 5) turns around the RM-cells and sends them back to the origin node (node 2) as backward RM-cells. The successive nodes in the ATM backbone update the backward RM-cells with information concerning the bandwidth/rate available/allowed for the ABR VPC. The RM-cells are then used to provide a flow control interface between the access network and the backbone network.

[0182] If an RM-cell is received by the origin node (node 2) of the ABR VPC with a new bandwidth notification, the traffic will be adjusted according to the new availability of the network:

[0183] If a bandwidth decrease is notified, traffic sources will limit their traffic to avoid cells loss in the origin node (node 2) of the ABR Virtual Path Connection (VPC).

[0184] If a bandwidth increase is notified, traffic sources will be informed that it is possible to generate more traffic.

[0185] Bandwidth Adjustable Continuous Bit Rate Virtual Path Connection (CBR VPC)

[0186] FIG. 16 shows the traffic on a transmission link in a backbone network where voice traffic (or more generally SVCs or Switched Virtual Connections) has priority over data traffic (or more generally PVCs or Permanent Virtual Connections) issued from access networks, and more particularly where the establishment of a certain number of voice connections (SVCs) is guaranteed while allowing the remaining bandwidth on the link to be used by data traffic (PVCs) if these voice connections are not requested.

[0187] To simplify the description, an example is discussed wherein SVCs are dedicated to voice traffic while PVCs are used for data traffic. Of course, this can be generalized to give priority to SVCs calls, whether they transport voice or data, over permanent connections (PVCs).

[0188] The backbone network design is such that a minimum of bandwidth is left for data traffic during the peak hours. Once the voice load decreases, more bandwidth is advertised for data traffic (PVCs). FIG. 16 shows a graphical example of what is achieved. More particularly FIG. 16 shows the bandwidth that is available for data traffic. This bandwidth varies according to the voice traffic.

[0189] Within the backbone network on transmission links where voice and data are mixed, the available bandwidth fluctuates according to the number of voice connections (SVCs) which are established and disconnected within a given period of time. In practice, the backbone voice load fluctuates slowly; consequently, it is not necessary to track the establishment and disconnection of the voice connections continuously (or every X micro or milli seconds). A slow mechanism, able to adapt the bandwidth every ten seconds is sufficient. Thus, in an ATM backbone network transporting data and voice traffic issued from ATM access networks, it is possible to build Continuous Bit Rate Virtual Path Connections (CBR VPCs) in the backbone network and to slowly modify their bandwidth according to the backbone voice traffic:

[0190] If the voice traffic on the backbone network increases, the bandwidth allocated to the data CBR VPCs will decrease.

[0191] If the voice traffic on the backbone network decreases, more bandwidth will be available for the data CBR VPCs.

[0192] FIG. 7 is a general view of such an ATM network, where nodes 2 and 5 are two access nodes interfacing with the backbone network through respectively nodes 3 and 4. The PBXs 1, 2, 3, 4 access the backbone network either directly (PBX 1, 2 and 3) or through an access node (PBX4 using node 5). Traffic sources (user 1 and user 2) are connected to the ATM network by means of access nodes (node 1 and node 8) through Permanent Virtual Circuits (PVCs) and a connection is established over the backbone network using access nodes 2 and 5 (nodes 6 and 7 are transit nodes in access network 2). Nodes 2 and 5 are connected by means of a single CBR Virtual Path Connection (VPC) and the traffic of the Virtual Channel Connections VCC1 and VCC3 is transported over this VPC. In the present example, the CBR VPC is using the resources of links between nodes 2 and 3, 3 and 9, and 4 and 5. If a voice connection (SVC) is set up between PBX 1 and PBX 3 using link between nodes 3 and 9, there will be competition on this link between this voice traffic (SVC) and the Virtual Path Connection (VPC) between node 2 and node 5. If voice has the highest priority, it is important to make sure that there is always bandwidth available to accept the establishment of new voice connections (SVCs). This means:

[0193] reduction of the bandwidth allocated to the CBR VPC (supporting PVCs) if there is not enough bandwidth available on the link, and

[0194] increase of the bandwidth allocated to the CBR VPC (supporting PVCs) if there is too much bandwidth available on the link.

[0195] In order to provide an end to end service, it is necessary to provide a good “flow control” interface between the ATM backbone network, which determines the bandwidth allocated to each CBR Virtual Path Connection (VPC), and the ATM access networks, which convey the traffic from the sending end-systems (source nodes) up to the ATM backbone network. The information concerning the bandwidth available on the backbone network for a given Virtual Path Connection (VPC) is used by the nodes having access to the backbone network (nodes 2 and 5) for increasing or decreasing the transmission rate of the traffic source (user 1).

[0196] Backbone Topology

[0197] Topology Services

[0198] The topology services are used for distributing and maintaining information concerning the logical and physical backbone network (including link utilization information) in every backbone node. In the preferred embodiment (refer to IBM's NBBS architecture), this information, in particular the utilization and reservation of the bandwidth, is collected and distributed periodically to each backbone network node thanks to a control spanning tree. Each node stores in its own Topology Database (TDB) information about nodes, links, their properties and the bandwidth utilization and allocation. The topology information is replicated in each backbone node. An algorithm guarantees the correctness of each node's Topology Database when links and nodes are added or deleted or when their characteristics change.

[0199] Control Spanning Tree

[0200] The control spanning tree is a logical structure which joins all the nodes which are physically connected together in a network. It allows information that has to go to every node to be sent very quickly and efficiently. It is maintained dynamically by topology services. The spanning tree is used for:

[0201] distributing control information (in parallel) including link utilization, and

[0202] updating the Topology Database of the nodes with new network configurations or link/node failures.

[0203] Topology Database (TDB)

[0204] The Topology Database contains information about nodes, links, their properties, and the bandwidth allocation, in particular:

[0205] the physical topology of the network which includes static information like physical characteristics of nodes and links,

[0206] the state of nodes and links, and

[0207] the link utilization which includes dynamic characteristics like current bandwidth (used and reserved), and real-time measurements.

[0208] Each resource in the network, nodes or links, is associated with an entry in the database. In particular, each link entry includes the following characteristics:

[0209] the link physical properties:

[0210] transmission medium and speed,

[0211] routing mode supported,

[0212] maximum packet size,

[0213] link buffer capacity,

[0214] propagation delay,

[0215] bandwidth reservation supported.

[0216] the link state:

[0217] on-line (link can accept user connections),

[0218] quiescent (link cannot accept additional user connections, but existing connections continue),

[0219] off-line (link cannot accept user connections and existing connections are canceled.

[0220] the link utilization:

[0221] real-time measurements,

[0222] reserved bandwidth.

[0223] In particular, the Topology Database (TDB) contains, for each link, its total capacity. The value C_krepresents the total bandwidth available on the link k.

[0224] Backbone Bandwidth Management Server

[0225] FIG. 18 is a view of a network comprising a first access network (access network 1) comprising an end node (node 1) connected to a user 1 and a source node (source node 2), a backbone network comprising a plurality of nodes (nodes 3, 4, and 9), and a second access network (access network 2) comprising a destination node (destination node 5), transit nodes (nodes 6 and 7), and an end node (node 8) connected to a user 2. The CBR VPC established between nodes 2 to 5, transmits, to node 5, traffic of end user 1 (VCC1). In node 5, the traffic is transmitted to end user 2 (VCC2).

[0226] In order to adjust the bandwidth of each bandwidth adjustable CBR VPC, a server called Backbone Bandwidth Management Server (BBMS) is defined as shown in FIGS. 11 and 18. There is one active server (other servers may be used as backup) for the whole backbone network and this centralized server has the knowledge of the network topology and traffic load. It periodically maintains and updates this information thanks to the backbone topology services described previously. The Backbone Bandwidth Management Server (BBMS) can be implemented in any of the nodes maintaining a Topology Database. The process for choosing a node to host the Backbone Bandwidth Management Server (BBMS) is out of the scope of this invention. For instance a node which is already used as root of the spanning tree can be a good candidate to host the BBMS function. Another solution is to process the Backbone Bandwidth Management Server (BBMS) function on an independent station such as a RISC (Reduced Instruction Set Computer) station using Network Management Services to retrieve the network topology from one of the network nodes.

[0227] The Backbone Bandwidth Management Server (BBMS) is in charge of optimizing network utilization. However, the backbone network is optimized a posteriori: bandwidth adjustable Continuous Bit rate (CBR) Virtual Path Connections (VPCs) are established with an initial bandwidth BI independently of the Backbone Bandwidth Management Server (BBMS). Their bandwidth is adjusted dynamically according to the fluctuations of the voice traffic (SVCs). The value of the initial bandwidth BI is defined a priori by the network administrator. The Backbone Bandwidth Management Server (BBMS):

[0228] sends requests to backbone nodes to reduce or increase the bandwidth allocated to the bandwidth adjustable Continuous Bit Rate (CBR) Virtual Path Connections (VPCs) in charge of transporting Permanent Virtual Connections (PVCs), and

[0229] reroutes bandwidth adjustable CBR VPCs within the backbone network for balancing the traffic among transmission links and for ensuring fairness among VP Connections.

[0230] The Backbone Bandwidth Management Server (BBMS) requests services from the Connection Admission Control (CAC) for:

[0231] getting the initial bandwidth requests BI,

[0232] increasing/decreasing bandwidth of bandwidth adjustable CBR VPCs, and

[0233] rerouting bandwidth adjustable CBR VPCs.

[0234] Connection Allocation Table

[0235] As shown in FIGS. 11 and 18, in the Backbone Bandwidth Management Server (BBMS) environment, a table called Connection Allocation Table (CAT) is defined. This table comprises an entry per connection (VPC or VCC/PVC or SVC) established in the backbone network and each entry includes information required to adjust the bandwidth of the CBR VPCs:

[0236] the VPC or VCC name,

[0237] the CAC identifier to identify the CAC that owns the connection,

[0238] the initial bandwidth Bi_jallocated to the VPC j or VCC j,

[0239] the marginal bandwidth BM_jcurrently allocated to the bandwidth adjustable CBR VPC j, and

[0240] an indicator for identifying whether the connection is adjustable or constant.

[0241] Notes:

[0242] In the present description, CBR VPCs are considered as adjustable while VCCs have a constant bandwidth. However, the indicator for identifying adjustable or constant connections allows the generalization of the process.

[0243] The bandwidth which is currently allocated to a bandwidth adjustable CBR VPC j is equal to the sum of the initial bandwidth with the marginal bandwidth (BI_j+BM_j).

[0244] The bandwidth which is allocated to a VCC j/SVC j is equal to BI_j(constant bandwidth).

[0245] The values BI_jare exclusively related to connections j and are independent of links.

[0246] The marginal bandwidth BM_jcan take a positive or negative value if BI_jis considered as a mean value. Another possibility is to consider Bi_jas the minimal bandwidth and to limit BM_jto positive values.

[0247] Link Allocation Tables

[0248] As shown in FIGS. 11 and 18, in the Backbone Bandwidth Management server (BBMS) environment, a set of tables called Link Allocation Tables (LAT_k) is defined, one for each link k in the backbone network. Each table comprises an entry per bandwidth adjustable CBR VPC established on the link k and each entry includes information required to adjust the bandwidth of this CBR VPC:

[0249] the CBR VPC name, and

[0250] the marginal bandwidth BM_j,kavailable for the bandwidth adjustable CBR VPC j on link k.

[0251] Bandwidth Adjustment Parameters

[0252] The Backbone Bandwidth Management Server (BBMS) maintains the following information:

[0253] 1. The initial bandwidth request BI_j

[0254] The Connection Allocation Table (CAT) is updated with the initial bandwidth request each time a new connection (VPC/VCC) is established or an existing connection is disconnected in the backbone network. Bi_jis the initial bandwidth request of connection j.

[0255] The following parameters are computed for each link k:

[0256] Sum_BI_kis the sum of all initial bandwidth requests Bi_jof connections j using link k.

[0257] Sum_BI_CBR_kis the sum of the initial bandwidth requests BI_jfor all bandwidth adjustable CBR VPC j on link k (obviously Sum_BI_CBR_k<=Sum_BI_k).

[0258] Note: more generally Sum_BI_CBR_kis computed for every connection with an indicator set to “adjustable connection”.

[0259] 2. The marginal bandwidth currently allocated by the Backbone Bandwidth Management Server (BBMS). This additional bandwidth is centralized and maintained in the BBMS only.

[0260] BM_j,kis the marginal bandwidth available for the bandwidth adjustable CBR VPC j on link k (BM_j,kis equal to 0 for constant connections).

[0261] BM_jis the marginal bandwidth allocated to the bandwidth adjustable CBR VPC j in the backbone network=BM_j=min_k(BM_j,k)=minimum marginal bandwidth available along the path of the connection.

[0262] Sum_BM_kis the sum of the marginal bandwidths available for link k.

[0263] The bandwidth which is reserved on a given link k according to all initial requests BI_jis equal to Sum_BI_k. This bandwidth is always lower than the link capacity C_k. The bandwidth allocated to a connection j is equal to the initial bandwidth request plus the minimum value of the marginal bandwidth currently available along the path of the connection (BI_j+min_k(BM_j,k)). The bandwidth reserved on link k is lower or equal to Sum_BI_k+Sum_BM_k.

[0264] Bandwidth Adjustment

[0265] FIG. 19 is a flow chart of a method for dynamically adjusting the bandwidth of a Continuous Bit Rate (CBR) Virtual Path Connection (VPC) according to the periodically updated PVC and SVC reservation levels:

[0266] 1901. Initially, the bandwidth adjustable CBR Virtual Path Connection (VPC) j is established by an origin node in the backbone network (for instance by node 3 in FIG. 18). A route is selected according to the CBR VPC initial bandwidth request BI_j, the current reservation levels on the links, the CBR quality of service and so forth. These operations are performed by the Connection Admission Control (CAC) of the origin node. The CAC informs the Backbone Bandwidth Management server (BBMS) each time a VPC is established or disconnected.

[0267] The same operations are performed for SVCs/VCCs. The only difference is that the connection is marked as constant bandwidth in the BBMS Link Allocation Tables (LAT_k).

[0268] 1902. Each time a new connection is established, the Backbone Bandwidth Management Server (BBMS) updates the Connection Allocation Table (CAT) with the initial bandwidth request BI_jand intitialize the marginal bandwidth in the Link Allocation Tables to a value 0.

[0269] 1903. In its background process, in a continuous or periodic mode, the Backbone Bandwidth Management Server (BBMS) monitors, for each link k, the reservation levels of the bandwidth adjustable CBR VPCs and constant bandwidth connections (SVCs). It determines the level of additional bandwidth that can be allocated to each bandwidth adjustable CBR VPCs:

[0270] BM_j,k=(C_k−Sum_—BI_k)×BI_j/Sum_—BI_CBR_k  (1)

[0271] The above expression determines the amount of unallocated bandwidth on the link k which is equal to (C_k−Sum_BI_k) and gives a fair share of this bandwidth to every bandwidth adjustable CBR VPCs. Here, the share is proportional to the initial bandwidth requests BI_j.

[0272] The Link Allocation Tables (LAT_k) are updated with the computed marginal bandwidths BM_j,k.

[0273] 1904. The marginal bandwidth that can be allocated to a bandwidth adjustable CBR VPC is actually the minimum that each link k can accept along the path of the connection:

[0274] new_—BM_j=min_k(BM_j,k).

[0275] 1905. A test determines whether a significant change is observed in new_BM_jor not:

[0276] absolute value of (new_—BM_j−BM_j)>given threshold?

[0277] 1906. If yes, the Backbone Bandwidth Management Server (BBMS) requests the Connection Admission Control (CAC) of the origin node to adjust the bandwidth with the new bandwidth (BI_j+BM_j). The BBMS also updates the Connection Allocation Table (CAT) with the new value BM_j.

[0278] 1907. Otherwise, the current value of BM_jremains unchanged.

[0279] 1908. The Connection Admission Control (CAC) receives the value of the new bandwidth from BBMS.

[0280] 1909. The Connection Admission Control (CAC) adjusts the bandwidth allocated to the bandwidth adjustable CBR VPC by comparing the new bandwidth with the previous one. The CAC:

[0281] 1910. reduces the bandwidth of the bandwidth adjustable CBR VPC if the new bandwidth is lower than the previous one, or

[0282] 1911. increases the bandwidth of the bandwidth adjustable CBR VPC if the new bandwidth is higher than the previous one.

[0283] Note: The expression (1) is quite simplistic but can be improved taking into consideration several factors:

[0284] a protection against overbooking to make sure at least a few voice connections (SVCs) can be accepted at any time before the Backbone Bandwidth Management Server (BBMS) performs the post-optimization. This protection may not be required. If required, this protection is achieved by defining a link speed/capacity that is lower than the actual link speed/capacity. The new expression is:

[0285] BM_j,k=(C′_k−Sum_—BI_k)×BI_j/Sum_—BI_—CBR_k  (1)

[0286] with C′_k=actual link capacity−bandwidth for anticipated voice connections (SVC calls) and

[0287] a minimum bandwidth reserved for bandwidth adjustable CBR VPCs. This bandwidth is to be taken into account in the path selection process for voice connections (SVC calls).

[0288] Fairness and Load Balancing

[0289] In its background process, but with a lower frequency (for instance every 10 minutes), the Backbone Bandwidth Management Server (BBMS) monitors the network reservation levels to make sure that the network is correctly balanced or that bandwidth is fairly shared among bandwidth adjustable CBR Virtual Paths Connections (VPCs). The criteria are:

[0290] either a too large difference between the current allocated bandwidth and the initial bandwidth request, i.e., BM_j<given negative threshold. If this criterion is met, the bandwidth adjustable CBR VPC is rerouted, or

[0291] a too large difference of bandwidth allocation between Virtual Path Connections,i.e., max_j((BI_j+BM_j)/BI_j)−min_j((BI_j+BM_j)/BI_j)>given threshold, where the given threshold defines the level of tolerance. If this criterion is met, the bandwidth adjustable CBR VPC with the lowest additional bandwidth BM_j/BI_jis rerouted first.

[0292] In both cases, the reroute request in the Connection admission Control (CAC) triggers a new path selection process to re-optimize the bandwidth allocation within the backbone network:

[0293] If a better path cannot be found, the bandwidth adjustable CBR Virtual Path Connection (VPC) remains with its current allocation,

[0294] If a better path can be found, a Non Disruptive Path Switch (NDPS) occurs to take advantage of the new path.

[0295] Learning Curve

[0296] To improve the network response time and to make sure all voice connections (SVC calls) are accepted at peak hours, statistics are recorded along the day, and the behavior of these voice connections is simulated. This allows the Bandwidth Management Server to anticipate the SVC requests and to reduce the bandwidth allocated to bandwidth adjustable CBR Virtual Path Connections (VPCs) before the demand actually occurs.

[0297] CBR VPC Bandwidth Updates

[0298] When the bandwidth of the CBR VPC varies, the VPC source (node 2) may be informed of this change either implicitly, by observing the packet/cell loss rate for instance, or explicitly.

[0299] In the latter case, as the Virtual Path Connection (VPC) is defined for a Constant Bit Rate (CBR) service category, the ATM Available Bit Rate (ABR) mechanism is not adapted. However, referring back to FIG. 18, the node 3 at the edge of the backbone network can send an RM-cell (RM-cell identical to ABR RM-cells or RM-cell with a proprietary format) to access node 2. This RM-cell transmits the new transmission rate or new bandwidth allocated by the Backbone Bandwidth Management Server (BBMS) to the bandwidth adjustable CBR VPC. The function of the access node 2 is at least to adjust the shaper of the bandwidth adjustable CBR VPC according to the new allocated bandwidth. The access node can then take various actions on the ATM Virtual Channel Connections (VCCs) that are multiplexed over the CBR VPC. For instance, it can:

[0300] act as an ABR Virtual Destination for some VCCs,

[0301] reduce or increase arbitrarily the bandwidth on some VCCs,

[0302] drop some VC Connections in case of bandwidth reduction, and

[0303] trigger the Explicit Forward Congestion Indication (EFCI).

[0304] CBR VPC with ABR VPC Interface

[0305] FIG. 11 shows how ATM access networks and the ATM backbone network communicate together using standard RM-cells in the context of a CBR VPC in the backbone accessed by an ABR VPC according to the present invention. The CBR VPC in the backbone is managed by the Backbone Bandwidth Management Server (BBMS) by means of tables such as the CAT and CATk tables, and the TDB.

[0306] 1. An Available Bit Rate Virtual Path Connection (ABR VPC) is set up between the end node (node 2) of the source access network (access network 1) and the first backbone node connected to it (node 3: backbone access node). RM-cells within this ABR VPC may be generated at wide intervals of time, because the ABR VPC bandwidth is adjusted in accordance with the slow variations of the CBR VP bandwidth.

[0307] 2. The origin node of the ABR VPC (node 2: end node of the ATM access network) generates Resource Management cells (RM-cells) and sends them to the first backbone node connected to it (node 3: backbone access node).

[0308] 3. The access node of the ATM backbone network (node 3) updates the RM-cells with the bandwidth/rate allocated by the Connection Admission Control (CAC) to the CBR VP and sends them back as backward RM-cells to the origin node (node 2) of the ABR VPC. The ABR RM-cells are then used to provide a flow control interface between the source access network and the backbone network.

[0309] If an RM-cell is received in the origin node (node 2) of the ABR VPC with a new bandwidth notification, the traffic will be adjusted according to the new availability of the network. If a bandwidth decrease is notified, traffic sources will have to limit their traffic to avoid cells loss in the origin node (node 2) of the ABR Virtual Path Connection (VPC); if a bandwidth increase is notified, traffic sources will be informed that it is possible to generate more traffic.

[0310] Bandwidth Management

[0311] Virtual Channel Connections (VCCs)

[0312] As shown in FIG. 12, an Available Bit Rate (ABR) or a bandwidth adjustable Continuous Bit Rate (CBR) Virtual Path Connection (VPC) can transport a plurality of Virtual Channel Connections (VCCs) using different service categories:

[0313] (a) CBO/CBR connections

[0314] At connection set-up, the bandwidth corresponding to the Peak Cell Rate (PCR) value (=mean rate) of the connection is allocated along a preselected path in the ATM access network.

[0315] (b) Frame Relay or ATM (FR/ATM) fixed bandwidth (classical) connections (sustainable rate)

[0316] At connection set up, a bandwidth is allocated along a preselected path in the ATM access network. The allocated bandwidth remains unchanged during all the life of the connection.

[0317] (c) Reserved connections with bandwidth adjustment option NBBS—Networking BroadBand Services—connections)

[0318] At connection set up, a bandwidth is allocated along a preselected path in the ATM access network. The allocated bandwidth is based on an initial mean rate. Then, depending on the behavior of the source, measured by a policing module, the bandwidth of the VCC is adjusted (increased or decreased). The initial mean rate of the connection normally corresponds to the long term mean rate which is estimated for the connection. A minimum bandwidth reservation can be specified. Additional information concerning NBBS connections can be found in the publication entitled “Networking Broadband Services (NBBS)—Architecture Tutorial”, IBM International Technical Support Centers, June 1995, GG24-4486-00.

[0319] (d) Frame Relay or ATM non reserved connections/minimum reserved connections

[0320] Frame Relay or ATM connections can be totally non reserved (Unspecified Bit Rate UBR for ATM) or non reserved with a minimum bandwidth reservation (ABR for ATM). The bandwidth allocated to these connection is either null or equal to the minimum cell rate (MCR for ABR).

[0321] End Nodes in ATM Access Networks

[0322] The present method of sharing bandwidth among connections of different categories in a given ABR or CBR Virtual Path Connection (VPC) is implemented in end nodes (node 2) of ATM access networks. Assuming that in these end nodes, there is a switch and a resource called “adapter” in charge of managing a given outgoing link or group of outgoing links, the method is implemented in the adapter responsible for the link supporting the Virtual Path Connection (VPC). Generally, an adapter comprises three parts:

[0323] two parts for processing the data traffic (switching/flow control functions), namely the receive and transmit elements; and

[0324] one part based on a processor, namely in a preferred embodiment a general purpose processor in charge controlling the emission and reception of the traffic. This processor comprises a module called “Virtual Path Connection Manager” (VPCM), dedicated to the control and management of the Virtual Path Connections (VPC) originated from the adapter. It is an implementation choice as to whether there is one VPCM per adapter or one VPCM per link. In the present embodiment, we will assume that there is one VPCM per link.

[0325] Virtual Path Connection Manager

[0326] In VPC source nodes, each Virtual Path Connection Manager (VPCM) monitors the bandwidth of the VPCs established on the link it is responsible for. The bandwidth information of these VPCs are updated and maintained in a table named Virtual Path Connection Table (VTCT). This table, one per link, comprises one entry for each connection with reserved bandwidth. VPCMs also determine the total amount of bandwidth which is allocated for each service category (CBR, VBR, ABR) on the link. The total bandwidth reserved for a specific service category is equal to the sum of the bandwidth reserved for each connection using the service category. Finally, VPCMs are responsible for signaling to a table known as the Topology Database (TDB) all information related to the bandwidth allocation of links. The Topology Database is updated each time a significant change in the bandwidth allocation of a link occurs and messages are sent to all other network nodes to update their own Topology Database.

[0327] Bandwidth Adjustment

[0328] FIG. 13 describes the bandwidth adjustment mechanism and in particular the relationship within a given line adapter between the receive element which receives the backward RM-cells and the transmit element which sends the traffic coming from the switch on the ABR or CBR Virtual Path Connection:

[0329] 1301. The receive element receives from the ATM backbone network a RM-cell associated to a particular ABR (standard RM-cell) or bandwidth adjustable CBR (proprietary RM-cell) VPC and extracts the transmission rate from the Congestion Indication (CI), No Increase (NI), and/or Explicit Rate (ER).

[0330] 1302. This transmission rate transported by the RM-cell in the CI, NI, ER . . . fields is transmitted to the Virtual Path Connection Manager (VPCM).

[0331] 1303. The Virtual Path Connection Manager (VPCM) re-initializes the shaper for the corresponding VPC, computing new shaping rates, and updating the VPC “allocated bandwidth” field in the Virtual Path Connection Table (VPCT).

[0332] 1304. From the bandwidth newly allocated to the VPC, the bandwidth of each VCC within this VPC is re-evaluated, based on the values maintained in the VPCT. The process is explained in FIG. 15.

[0333] When the bandwidth of an ABR or CBR Virtual Path Connection (VPC) is modified, the Virtual Path Connection Manager (VPCM) is in charge of computing the new bandwidth allocated to each Virtual Channel Connection (VCC) according to the new VPC bandwidth. In a preferred embodiment, a shaping function is provided to the transmit part of the adapter, in order to limit the transmission rate of the existing traffic to a predefined value.

[0334] Virtual Path Connection Table

[0335] In VPC source nodes, each Virtual Path Connection Manager (VPCM) monitors the bandwidth of the VPCs established on the link it is responsible for. In particular they update the Virtual Path Connection Table (VPCT) each time:

[0336] a Virtual Path Connection (VPC) is established or disconnected on the backbone network,

[0337] a Virtual Channel Connection (VCC) is established, disconnected, or adjusted. In this case, the information related to the allocation and utilization of the bandwidth of the corresponding VPC (the one which includes the VCC) is updated.

[0338] the bandwidth of the Virtual Path Connection (VPC) is adjusted (at the reception of the backward RM-cells returned from the backbone).

[0339] As shown in FIG. 14, for each Virtual Path Connection (VPC4, VPC2, VPC3, and so forth) established on the link it is responsible for (link1, link2, link3,and so forth), the Virtual Path Connection Manager (VPCM) stores and updates in the Virtual Path Connection Table (VPCT) among other information, the following parameters (values are given as example for VPC1 on link 1):

[0340] A: the bandwidth used by reserved fixed bandwidth connections (a & b, 3 Mbps),

[0341] B: the bandwidth used by reserved adjustable bandwidth connections (c, 25 Mbps),

[0342] C: the bandwidth reserved for fixed bandwidth connections (a & b, 5 Mbps),

[0343] D: the bandwidth reserved for bandwidth adjustable connections (c, 43 Mbps).

[0344] E: the sum of the minimum bandwidth reservation allocated to reserved connections (a, b & c, 15 Mbps)=sum of the bandwidth allocated to fixed bandwidth connections (a & b) plus minimum bandwidth reservation allocated to bandwidth adjustable connections (c).

[0345] F: the sum of the minimum bandwidth reservation allocated to ABR connections (d) (sum of MCRs: 2 Mbps).

[0346] G: the total bandwidth used (a, b, c & d, 45 Mbps).

[0347] H: the total bandwidth allocated (H=C+D+F=50 Mbps)

[0348] I: the number of non reserved Virtual Channel Connections (100 connections).

[0349] Note: For non reserved (NR) traffic, the Virtual Path Connection Manager (VPCM) includes the sum of the minimum reservation of the Available Bit Rate/Frame Relay (ABR/FR) connections if any, and the total number of non reserved connections VCCs routed through this link.

[0350] Periodically, or at particular events, the Virtual Path Connection Manager (VPCM) reports to the Topology Database (TDB) of the node, the status of the link under its responsibility, in term of allocated bandwidth for each category of service. The Topology Database(TDB) is used to select an optimum path for new connections based on the category of service and the status of resources within the network.

[0351] Bandwidth Allocation and Optimization

[0352] FIG. 15 is a flow chart of the bandwidth allocation process:

[0353] 1500. On reception of an RM-cell from an ABR or a bandwidth adjustable CBR Virtual Path Connection (VPC) with a Congestion Indicator (CI) field or/and a No Increase (NI) field, or/and Explicit Rate (ER) field indicating a new transmission rate (new_H), the Virtual Path Connection Manager (VPCM) operates as follows:

[0354] 1501. A test determines whether the new bandwidth (new_H) is higher than the previously allocated bandwidth (H) or not:

[0355] 1502. If the new bandwidth (new_H) is higher than the previously allocated bandwidth (H), the reserved VC Connections with bandwidth adjustment option (c), requesting additional bandwidth will be satisfied in priority. The VPCM waits for the complete adjustment of these reserved VC Connections (by means of a timer) before computing a new “non reserved” transmission rate for non reserved VC Connections (d). This transmission rate may be higher or lower than the previous one according to the requirements of the reserved VC Connections with the bandwidth adjustment option (c).

[0356] After adjustment of the reserved VC Connections (c) (at timer expiration), the available bandwidth or unused bandwidth, which is equal to the difference between the link capacity and the bandwidth actually used:

[0357] Link capacity−(A+B)

[0358] is measured. The bandwidth that “non reserved” VC Connections (d) can use above their minimum bandwidth (F) is equal to:

[0359] Link capacity−(A+B+F)

[0360] This total amount of bandwidth is then shared among the “non reserved” VC Connections (d) according to any ER computation algorithm (for instance EPRCA, ERICA—appendix I of ATM Forum Traffic Management Specifications Version 4.0).

[0361] If the new bandwidth (new_H) is lower than the previously allocated bandwidth (H), the VPCM:

[0362] 1503. computes the difference (DB) between the new bandwidth (new_H) and the previously allocated bandwidth (H):

[0363] DB=H−new_H

[0364] 1504. verifies whether the total reserved bandwidth (C+D+F) for all connections on the link which is equal to:

[0365] (C) reserved bandwidth for reserved fixed bandwidth VC Connections (a, b)+

[0366] (D) reserved bandwidth for reserved bandwidth adjustable VC Connections (c)+

[0367] (F) minimum reserved bandwidth for “non reserved” VC Connections (d) (ATM ABR or FR non reserved)

[0368] is always lower than the new bandwidth (new_H), or not:

[0369] 1505. If yes, the bandwidth of reserved VC Connections (a, b, c) and the reservable part of “non reserved” VC Connections (d) remain unchanged. The non reserved part of connections is calculated again.

[0370] 1506. If no, the non reserved part of the “non reserved” VC Connections (d) must be removed (no bandwidth allocated to “non reserved” VC Connections on top of the minimum reserved (MCR)).

[0371] 1507. the additional bandwidth that must be freed is equal to:

[0372] DB′=ĉ+D+F)−new_H

[0373] Note that here DB′ is always higher than 0 because C+D+F>new_H (step 1504).

[0374] A ratio must be applied to the reserved part of the VC Connections, assuming a certain priority among these connections: reserved VC Connections with adjustable bandwidth (c) are impacted.

[0375] 1508. Assuming (E) the sum of the minimum bandwidths of the reserved VC Connections with constant (a, b) or adjustable bandwidth (c), and ĉ+D), the sum of the current reserved bandwidths, the VPCM computes the adjustable reserved bandwidth of VC Connections (d):

[0376] ĉ+D−E)

[0377] and compares the result with DB′:

[0378] 1509. if (C+D−E)>DB′, then the bandwidth for the reserved VC Connection i (c) becomes:

[0379] new_reserved bandwidth (i)=(old reserved bandwidth(i)−minimum bandwidth reservation (i))×DB′/(C+D−E)+minimum bandwidth reservation (i)

[0380] The ratio R:

[0381] R=(new_reserved bandwidth (i)−minimum reserved bandwidth (i))/(old_reserved bandwidth (i)−minimum reserved bandwidth (i))

[0382] R=DB′/(C+D−E)

[0383] is sent to the sources (ATM/FR access nodes) in order for them to modify in view of this ratio the bandwidth allocated to their reserved VC Connections (c) on top of the minimum bandwidth reservation. The new connection bandwidth is computed as follows in the access nodes:

[0384] minimum bandwidth reservation (i)+R×(old_reserved bandwidth (i)−minimum bandwidth reservation (i))

[0385] 1510. if (C+D−E)<DB′, then:

[0386] new_reserved bandwidth (i)=minimum bandwidth reservation (i)

[0387] At this level, all the adjustable bandwidths have been reduced to their minimum:

[0388] there is no non reserved bandwidth on top of the minimum reserved rate (MCR) for “non reserved” VC Connections (d), and

[0389] there is no bandwidth allocated on top of the minimum bandwidth reservation for bandwidth adjustable reserved VC Connections (c).

[0390] 1511. The next step is to preempt VC Connections (a, b, c, or d), based on the level of priority in accordance with the network architecture used. For example, the NBBS (Networking Broadband Services) architecture provides two levels of priority (low priority and high priority). In the preferred embodiment, it is assumed that the last case will not arrive, and could be avoided with a judicious setting of the minimum rates of the connections. For real time (RT) and non real time (NRT) constant bandwidth Virtual Channel Connections (VCCs) (a, b), it is assumed that there will be always sufficient bandwidth left to the bandwidth adjustable Virtual Path Connection (VPC) required to transport such connections.

[0391] While the present invention has been described in the context of bandwidth adjustable Continuous Bit Rate (CBR) Virtual Paths Connections (VPCs), its scope of utilization can be enlarged to all types of bandwidth adjustable Virtual Path Connections (VPCs).

[0392] While the invention has been particularly shown and described with reference to a preferred embodiment, it will be understood that various changes in form and detail may be made therein without departing from the spirit, and scope of the invention.