Tuple-based information space for data exchange between applications

[0002] This application is a Continuation-In-Part of U.S. application Ser. No. 09/305,427 entitled “Method for Coordinating Activities And Sharing Information Using a Data Definition Language” filed May 5, 1999 still pending. That disclosure is incorporated in this document by reference.

[0003] The present invention is generally related to computer networking. More specifically, the present invention includes a mechanism that provides application-layer information persistence and exchange. This mechanism is scalable, generically applicable, transparently-distributed and based on the tuple-space model.

[0004] Most modern computer systems are designed to use a layered approach to interprocess communication and networking. The layered approach subdivides the tasks associated with interprocess communication and networking into levels of abstraction. This has been found to be an effective method for reducing the complexity and increasing the reliability of programs and systems that use interprocess communication.

[0005] The International Organization for Standardization (ISO) has promulgated a commonly used standard that embodies a layered approach of this type. This standard, know as the ISO Network Reference Model, is based on seven different levels of abstraction. The seven layers are known as the application, presentation, session, transport, network, data link and physical layers.

[0006] The communications protocols used in the lower levels of the ISO Network Reference Model (i.e., the transport, network, data link and physical layers) are relatively well defined. As a result, these protocols tend to be used, for almost all applications that perform interprocess communication.

[0007] Unfortunately, this type of homogeneity does not really exist at higher levels of the ISO Network Reference Model. Entities at these levels (i.e., the application, presentation and session layers) tend to interact with their peers using special-purpose protocols. Not surprisingly, this type of one off use does little to further the overall effectiveness of the ISO Network Reference Model. Instead, there is a tendency towards increased complexity and lost opportunities for software reuse.

[0008] The ISO Network Reference Model is, unfortunately, not the only networking environment that exhibits this lack of homogeneity. In fact, these symptoms are generally present (to a greater or lesser extent) in all layered interprocess communication and networking systems.

[0009] For these and other reasons, a need exits for more generic methods that provide interprocess communication at higher levels of layered interprocess communication and networking systems. Methods of this type would preferable provide uniform interprocess communication protocols at the application level of the ISO Network Reference Model. These methods would also preferably be scalable to work in networks of all sizes without significant performance degradation.

[0010] The present invention includes a method and apparatus for providing application-layer information persistence and exchange. For an exemplary embodiment, an information space is constructed to span a group of one or more server systems. The information space is based on the tuple-space paradigm first introduced for the Linda coordination model. A coordination entity manages storage of tuples within the information space. The coordination entity determines where in the information space tuples are stored. The coordination entity makes this determination both at initial tuple storage and as tuples are moved to achieve load balancing and other goals.

[0011] Applications access stored tuples by requesting the tuple from their local servers. If the local server knows where the tuple is stored, the local server forwards the request directly to the storing server. In the alternative, (i.e., where the local server does not know where a tuple is stored), the local server queries the coordination entity for the tuple's location. The local server then uses the query result to request the tuple from the storing server. In this case the local server also records the location of the tuple for future reference. This allows the local server to directly request the tuple on subsequent accesses.

[0012] In some cases, a tuple will have moved after a local server has noted its previous location. If that local server requests the moved tuple, the previously storing server will receive the request. In this case, the previously storing server generates a re-route exception. The re-route exception causes the local server to query the coordination entity to determine the tuple's new location. This new location is then noted by the local server for future requests.

[0013] The use of tuples and tuple matching allows applications to use a common, flexible, lightweight format for information persistence and interchange. The applications may be local or remote and of heterogeneous types.

[0014] Advantages of the invention will be set forth, in part, in the description that follows and, in part, will be understood by those skilled in the art from the description herein. The advantages of the invention will be realized and attained by means of the elements and combinations particularly pointed out in the appended claims and equivalents.

[0015] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate several embodiments of the invention and, together with the description, serve to explain the principles of the invention.

[0016] FIG. 1 is a block diagram of a computer network shown as an exemplary environment for an embodiment of the present invention.

[0017] FIG. 2 is a block diagram of a server computer system as used in the network of FIG. 1.

[0018] Reference will now by made in detail to preferred embodiments of the invention, examples of which are illustrated in the accompanying drawings. Wherever convenient, the same reference numbers will be used throughout the drawings to refer to the same of like parts.

[0019] In FIG. 1, a computer network 100 is shown as a representative environment for an embodiment of the present invention. Computer network 100 includes a number of servers, of which servers 102athrough 102fare representative. Servers 102athrough 102fare intended to be representative of the wide range of large and small computer systems that are used in computer networks of all types.

[0020] FIG. 2 shows a representative implementation for a server system 102. Structurally, server 102 includes a processor, or processors 202, and a memory 204. Processor 204 can be selected from a wide range of commercially available or custom types. An input device 206 and an output device 208 are connected to processor 202 and memory 204. Input device 206 and output device 208 represent a wide range of varying I/O devices such as disk drives, keyboards, modems, network adapters, printers and displays. Each server 102 may also includes a disk drive 210 of any suitable disk drive type (equivalently, disk drive 210 may be any non-volatile mass storage system such as “flash” memory). The memory 204 includes browser 212 and agent 214.

[0021] Network 100 and servers 102 provide the physical underpinnings for an information space. The information space allows applications, executing within network 100 to store and exchange information. The information space is based on the tuple-space paradigm first introduced for the Linda coordination model. Tuples in the information space are defined in terms of an abstract base class. The base class includes methods that correspond to the methods in the Linda coordination model. The methods include:

[0022] write (entry)

[0023] read (template)

[0024] read-if-exists (template)

[0025] take (template)

[0026] take-if-exists (template)

[0027] The use of these methods and their correspondence to the methods in the Linda coordination model are more completely described in co-pending U.S. application Ser. No. 09/305,427 entitled “Method for Coordinating Activities And Sharing Information Using a Data Definition Language” filed May 5, 1999. That disclosure is incorporated in this document by reference. As described in that disclosure, the methods are preferably configured to store and retrieve information using XML—an emerging standard for internet data definition.

[0028] In general, it should be appreciated that the present invention is intended to have general applicability. Thus, the use of the particular methods described or the use of XML are intended to be exemplary. The present invention is specifically intended to be applicable to a wide range of Linda-like methods and information storage methodologies.

[0029] The base class is preferably used to define a single server subclass and a distributed server subclass. The single server subclass is used in cases where an information space is constructed to include only a single server 102. The distributed server subclass is used for cases like network 100 where multiple servers 102 are used. Each of these subclasses defines its own tuple subspace function. The tuple subspace function defined for the single server subclass directs all requests to store or access tuples to the single server 102. The tuple subspace function defined for the distributed server subclass routes all requests to store or access tuples to the server 102 where the tuple is or should be located.

[0030] Network 100 includes a coordination entity. The coordination entity is a network service hosted by one of the servers 102 included in network 100. In some cases, the coordination entity may be replicated on several servers 102 to increase fault tolerance or throughput. The coordination entity manages the storage of tuples within the information space included in network 100. In general terms, this means that the coordination entity controls the distribution of tuples across servers 102 (tuple management). The coordination entity also plays a key role in helping applications find the servers 102 where tuples are located (tuple routing).

[0031] The coordination entity performs the tuple management function at various times to achieve various goals. As part of this role, the coordination entity determines where new tuples are stored as they are defined by applications within network 100. This determination is generally made in a way that distributes tuples across network 100. This tends to enhance both load-balancing and fault-tolerance. In other embodiments, tuples can be distributed to achieve other goals such as data-locality or server-preference. The coordination entity makes this initial determination each time the write () method is invoked to establish a new tuple.

[0032] The coordination entity may also perform the tuple management function to migrate existing tuples within network 100. This can be used, for instance, to redistribute tuples for better load balancing. Tuples may also be migrated as part of planned outages, fail-over or hot swapping of servers 102.

[0033] The coordination entity performs the tuple routing function whenever an application accesses a tuple within network 100. To perform an access of this type, an application invokes one of the read (), read-if-exists (), take () or take-if-exists () methods. These methods are configured to maintain a cache, preferable within each server 102, of known tuple locations. The methods consult this cache before attempting to access a tuple. If the location of a desired tuple is contained in the cache, the methods use the known location. The actual process of accessing the tuple can then proceed using a range of networking methods such as remote method invocation (RMI), remote procedure call (RPC) or socket.

[0034] In some cases, an access method will be unable to locate a desired tuple using the cache of know tuple locations. The access methods are configured to consult the coordination entity whenever a cache miss of this type occurs. The coordination entity can then provide an authoritative response detailing the location of the desired tuple. This location can be used to access the desired tuple. The response is also used to update the cache to record the location of the tuple.

[0035] For typical embodiments of the present invention, network 100 does not include a protocol that allows the various caches to be invalidated when a tuple is migrated or removed. The present invention provides for this contingency though the use of re-route exceptions. A server 102 that previously stored a tuple generates this exception if an accessing server attempts to access the now migrated or removed tuple. The access methods are configured to retry RMI, RCP, socket or other network operations that generate re-route exceptions. As part of the retry, the access methods consult the coordination entity. The coordination entity then provides an authoritative response detailing the location of the desired tuple. This location is used for the retry and used to update stale data located in the cache of the accessing server 102. In other cases, network 100 may be configured to use a protocol that automatically invalidates stale cache data through message passing or other methodology.

[0036] The Linda-like tuple interface combined with the distributed nature of the information space provides applications with a generic and scalable mechanism for information storage, persistence and exchange. Applications that use this mechanism may be local or remote. The mechanism fully supports use by heterogeneous applications.

[0037] Other embodiments will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. It is intended that the specification and examples be considered as exemplary only, with a true scope of the invention being indicated by the following claims and equivalents.