System and Method for Providing Compatibility Between Distributed File System Namespaces and Operating System Pathname Syntax

This invention relates to operating systems and related file systems for use in computer environments and, more particularly, to such systems in a distributed file sytem environment.

Most end-user applications consist of three basic components: a user interface, a computational function, and information storage. In the early evolution of computer systems, the general computing model for non-distributed applications was most frequently employed wherein these components were typically integrated in one system so as to be indistinguishable.

As the art developed, it became evident that numerous benefits could be obtained from distributed computing models wherein applications might be distributed across computer systems, the simplest approach being to break the application down into the hereinbefore noted components. It became apparent that a user interface, for example, might be remote from the computational function, and, in like manner, information storage might be remote, as in a distributed file system, and that even the routines which process the information in the files could be remote from the functions which manage the physical storage media. It was further realized as the art developed, that it may be desirable to even distribute portions of a component itself among multiple machines, the foregoing being aspects of what is known as distributed computing models.

Thus, high-powered individual computers and connectivity solutions (such as LANS and WANS) are now dramatically changing the way computers process information. The previously described isolated, dedicated, early single-user systems are no longer the norm. Today, users expect to reach beyond their desktop computers to exploit greater features, functionality, and performance. Distributed computing solutions have existed since the mid-1980's as, for example, in the Open Network Computing (ONC) and Network Computing System (NCS) systems from Sun Microsystems and Hewlett-Packard, respectively. Despite their availability distributed applications were a relatively scarce commodity because of difficulty in programming, with existing tools only being piecemeal solutions.

The distributed computing revolution challenged the computer industry to provide interoperability among components in heterogeneous, networked environments. Interoperability required more than mere connectivity a network in order to allow applications to exploit the potential resources in the networked environment and to provide dramatically improved performance. Developers, in exploiting this environment, required a complete set of tools within an architectural framework to ease development. As a result, a distributed computing environment arose to meet these needs in the form of a comprehensive integrated set of services known as the Distributed Computing Environment (DCE) by the Open Systems Foundation, which work across multiple systems remaining independent of any single system.

Numerous characteristics serve to define the DCE model. Among these are that DCE services are protected from a single point of failure by copying the services and important files to additional hosts in the network. Though many interdependencies exist among DCE components, the centralized control allows management of each component independently from the others whereby independently manageable sub-environments called cells are provided. Such decentralization minimizes bottlenecks whereby workloads are distributed among multiple hosts. The DCE system further provides flexibility in the decentralization permitting changing, adding, or reconfiguring hardware and software without impacting the surrounding environment. Although closely integrated, DCE's modular structure permits tailoring DCE configurations by installing DCE servers on computers with appropriate resources. DCE further harnesses latent computing power sitting idle in machines on the network by means of remote procedure calls (RPC) and DCE threads. Moreover, by the aforementioned technique of locating critical application servers on multiple hosts and replicating important files onto other systems, critical work may be kept in process while some systems fail, thereby providing increased availability.

Still further benefits to the DCE environment addressed limitations on local data storage by providing a distributed file service (DFS) which provides a single view of all files in an organization both to UNIX (Trademark of the X/Open Corporation) and non-UNIX systems to all users. This important DFS aspect of DCE will be hereinafter described in greater detail. The DCE environment further provides, by means of such DFS, a database storing the location of all files in the file service. When files move, the DFS automatically updates the database of the new location. Similarly, distributed application clients may use the DCE directory service to locate associated servers, thereby providing services which track data and programs. Moreover, the aforementioned DCE RPC hides differences in data requirements by converting data to appropriate forms needed by clients and servers, thereby accommodating heterogeneous data. These and other benefits to the DCE systems and, in particular the OSF implementation, gave rise to an increased interest in adoption of such systems with a concomitant need for further developments of the components thereof, such as the aforementioned DFS to be described in greater detail. Further background on distributed computing and DCE systems may be found in "Understanding DCE", Rosenberry, Kenney, and Fisher, by O'Reilly and Associates, Inc., Publishers, copyright 1992 and "OSF's Distributed Computing Environment", by Ram Kumar, AIXpert, copyright IBM Corporation, fall, 1991.

An overall high level view of the DCE architecture may be seen with reference to FIG. 2. It is layered between the operating system 10 and applications 12. Within DCE, three infrastructure components permeate all other components, namely the aforementioned remote procedure call (RPC) and presentation services 14 (which allow developers to program for a distributed environment as easily as a stand-alone system): security service, 16 (ensuring against unauthorized access), and management services 18 (providing utilities to manage DCE services).

Additional components of DCE depicted in FIG. 2 are as follows. A directory service 20 provides a way for users to name and locate objects, and is centrally positioned as a keystone of the architecture. It gives distributed system users a well known, central repository in which to store information which may be retrieved from anywhere in the distributed system. A time service 22 provides a consistent view of time in the distributed environment. Other fundamental services, 24, act as a place holder for future services. The distributed file services (DES) to be hereinafter described further, 26, provides a consistent unified view of all files in the distributed system. A diskless support service, 28, extends DCE to low-cost, diskless nodes. Other distributed services 30, will provide services likely to be offered in the future including spooling services, transaction services, and object-oriented environments.

To build distributed applications, developers need an easy-to-use programming model, such as the remote procedure call (RPC) 14, to take advantage of the distributed computing architectures. RPC allows developers to partition various tasks required by an application into separate procedure modules which may be executed on different systems. This offers benefits of an easy-to-use programming model, balanced, distributed use of computing resources, and the ability to run applications across diverse software and hardware platforms as previously described.

Still referring to FIG. 2, threads 32 allow multiple sequential flows of execution within a single process. Such threads provide a simple concurrency paradigm maintaining a synchronous model inside each thread while ensuring that synchronous events take place. In a client-server environment they allow servers to handle multiple clients simultaneously, and further allow clients to make multiple requests simultaneously, thereby providing better service availability. More detail regarding the RPC model 14 and its interaction with directory services 20 may be obtained in the aforementioned reference by Kumar.

It will be recalled that the DCE is thus a layer of software which masks differences between various kinds of hosts. Referring to FIG. 3, this layering may perhaps be more readily comprehended than in FIG. 2. The DCE 34 layer will be seen as sitting on top of the host operating system and networking services 10, and offers its services to applications 42 thereabove. From the conceptual model of DCE in FIG. 3, the relationship may be seen between the DCE distributed services (security 16, directory 40, and time 22 to RPC 14 and thread services 32). RPC and threads are base DCE services available on systems on which DCE is installed. From the layered appearance of FIG. 3, it will be more readily appreciated how similar to applications employing underlying DCE services for distribution the DCE file service 26 is. It will also be appreciated that the directory 40 actually includes a cell directory service (CDS) component 36 and X.500 directory service 38 (GDS) which programs utilize by calling the X.800 directory service (XDS) application programming interface 40.

Continuing with FIG. 3, it further illustrates how an application 42 may utilize DCE APIs. A distributed application does not require use of all DCE APIs but rather only utilizes those which it requires. Thus, in the illustration of FIG. 3, the application 42 might only require the RPC 14, security 16, XDS 40, and operating system APIs.

One important aspect of DCE relating directly to the present invention is the distributed file system (DFS) which will be described now in greater detail. An overview of DFS may be obtained in "An Overview of the OSF Distributed File System" by Lebovitz, AIXpert, February, 1992, copyright IBM and in the previous cite to the article by Kumar, incorporated herein by reference.

A distributed file system is an application allowing a user on one computer to easily access files on another. To the user, the distributed file system appears as a large, local file system.

Such distributed file systems have been in use for at least 20 years, with early development occurring at the Palo Alto Research Center (PARC) of the Xerox Corporation, wherein distributed file systems for LANs were experimented with in the early 1970's.

Most distributed file systems are similar to the original Xerox system. Files stored on a workstation disk are local files, and those stored on the central file system are referred to as remote files. When a workstation user tries to access a remote file, a message requesting information is sent through the network to the central file system. When the central file system receives the message, it obtains the requested information from its disk drive and sends it back to the workstation in another message. A user modifies a remote file in a similar way. Modified information is sent to the central file system in a network message. When the file system receives the message, it writes the modified information to its local disk.

A major drawback of such distributed file systems is the amount of resources they utilize. They require more network and remote file system resources than local sources, creating two problems. First, performance on the local computer is only as good as the performance of the central file system, e.g. increasing the power of the desktop computer does not necessarily increase overall system performance. Secondly, such a system cannot grow gracefully to an enterprise-wide system.

There are numerous more modern remote file systems presently in use which include the network file system (NFS) from Sun Microsystems, various distributed PC network file systems, notably from Apple, Banyan, Microsoft, and Novell, and various vendor-specific systems such as DECnet from Digital Equipment Corporation and Domain from Hewlett-Packard Corporation.

The evolution of computer technology has vastly increased the power of individual workstations and PCs. However, computers have evolved more quickly than distributed file systems which do not fully exploit the wealth of resources available. Several drawbacks accordingly are present in modern distributed file systems. These include lack of consistent and uniform file naming space, inconvenient multiple security systems in need of an integrated approach, data inconsistencies, lack of performance and scalability, weaknesses in system management and administration, incompatibility with file system standards, and lack of support for wide area networks.

As part of the hereinbefore described OSF's DCE, the distributed file system (DFS) component thereof took a new approach to building an enterprise-wide distributed file system. It employs modern high performance workstations and PCs, and exploits performance-enhancing techniques like caching and replication, thereby distinguishing DFS from earlier file systems. As but one example, by integrating a distributed file service 26 with the DCE directory services 20, DFS thereby allowed users to access files in a consistent manner from different workstations in a distributed computing environment. These directory services thereby ensured that the system utilized a uniform naming convention for all files stored in DFS. As previously noted, DCE directory services are based upon industry standards, ensuring that every computer resource in the world may be identified and accessed with a unique and consistent name --such resources including computers, application services, and files. Referring to FIG. 4, there is depicted an illustration of how a file located somewhere in a worldwide DCE file system may readily be located using the aforementioned global directly service (GDS).

Continuing with the background description of DFS, further information regarding DFS may be obtained from "The Distributed File System (DFS) for AIX/6000", document #GG24-4255-00, IBM Corporation, copyright May, 1994. As previously noted, DFS technology provides the ability to access and store data at remote sites similar to the technique used with NFS. It extends the view of a local, and therefore limited in size file system to the distributed file system of almost unlimited size located on several remote systems. Several advantages touched on previously are thereby provided over a centralized system including providing access to files from anywhere in the world (FIG. 4), higher availability through replication, and providing users on systems the ability to access data from a nearly unlimited data space. As such DFS is considered an essential part of DCE, and was basically an enhanced version of the Andrew File System (AFS) technology marketed by the Transarc Corporation and recently integrated into the base DCE technology.

Turning to FIG. 5, the distributed file system from DCE DFS is a collection of several file systems illustrated at 44-48 located on distributed systems. All such file systems are mounted into a single virtual file system space with a single namespace. The end-user thereby has direct access to all files in this distributed file system without knowing where the physical files reside. Still referring to FIG. 5, it will further be noted that a hierarchical structure is provided consisting of directories and files as is known from other Unix systems. The root of the DFS file structure is a junction 50 in the DCE naming space, and the multiple file sets 44-48 may reside on different servers and may be mounted into the DFS namespace.

Concerning overall DFS operation, DFS is built upon the concept of a client-server architecture. Turning to FIG. 6, a plurality of clients 52 and servers 54 are shown. The server provides data and the client uses the data. Communication between the server and client is handled with the previously described DCE remote procedure calls (RPC) 14. Systems in a DFS environment which own file systems export them and users on other systems access such file systems. Such file exporting machines are called DFS file server systems (e.g. DFS servers 54) and the importing machines are called DFS client systems (DFS clients 52). A machine can be both a server and client. FIG. 6 further shows the client/server nature of DFS.

Each DFS server system runs a corresponding file set exporter 54A which makes file systems 56 available to the DFS file space. DCE cells may have one or more DFS file servers, with two being shown in FIG. 6. As noted previously, a system may function as both a DFS client and DFS server. Each DFS client runs one or more client applications 58 which in turn may access cache on its respective client.

Turning now to FIG. 7, DFS clients run the cache manager 62, which caches data from the file exporter 54A in memory or on a local disk, such cache manager providing the important function of improving performance and availability. DFS server systems desiring to export file sets must register their export file sets at a system known as the file set location server 64. The file set location server maintains a database 66 of all file sets. This database is utilized to keep track of the physical locations where file sets are stored. If a DFS client 52 requires access to one of the file sets, it sends a request first to the file set location server/database 64, 66 to inquire about the physical location of the file set. After receiving location information, the client 52 then contacts the actual particular DFS file server 54 wherein the particular file set or file system 56 resides.

In addition to the previously discussed DFS machine roles providing the basic function of DFS file server machines, DFS client machines, and file set location servers, there are other functions or services which may be provided by one or more machines well known in the art. These services may be categorized into machine roles, not all of which are required. Moreover, a machine may actually serve more than one role, although more likely they will be spread out throughout a cell. Such machines known in the art include file server machines, private file server machines, file set location servers, DFS clients, system control machines, binary distribution machines, backup database machines, and tape coordinator machines, all of which are described in further detail in the aforementioned DFS for AIX/6000 publication.

Numerous basic benefits are provided by DCE DFS over other types of distributed file systems. These include providing a uniform file space, caching on the DFS client machine, finer granularity for access control, ability to establish binary distribution machines, ability to work on other vendor platforms, built-in backup capability, and diverse administration options.

As to the DFS relation to DCE, DFS is built on top of the underlying DCE services as previously described, taking advantage of the lower level services of DCE such as RPC, security services, directory and time services. Before DFS may configured on a machine, it requires the following DCE components be installed, configured, and running in the cell: security server, director server, and DCE time servers, all of which are also further described in detail in the aforementioned AIX article.

Referring now to FIG. 8, it first illustrates the required DCE components previously mentioned for running in a cell before DFS may be configured on a machine, namely the security server 62, cell directory server and DCE time servers 66. The further purpose of FIG. 8 is to not only show the aforementioned components for a DCE configuration, but additionally the DFS components which have been added to implement a DCE DFS cell, thereby also illustrating the different DFS machine roles. As previously described, DCE cell requirements are for at least one cell directory server 64, one security server 62 and at least three DCE distributed time servers 66. However, these are DCE requirements for a cell and not DFS requirements. The DCE cell may operate with the above requirements. However, in order to add the DFS capability to the DCE cell, the following additional components are required. First, all DFS clients 68 and servers such as DFS file servers 70 must be minimally configured as DCE clients. Secondly, at least one file set location database machine 72 is required and at least one system control machine 74 per administrative domain. A backup database machine and tape coordinator 76 are optional. Further details regarding these additional components to implement DFS on DCE may also be found in the aforesaid AIX publications.

It is at times desirable to operate differing operating systems in a DCE environment such as the OS/2 (Trademark of the IBM Corporation) operating system provided by the IBM Corporation. Such file systems typically (and specifically in the case of OS/2), include what is known as "attributes" of various types such as "extended" attributes and "file" attributes to be hereinafter described in great detail. One problem with the widely accepted OSF DCE DFS file system is that it does not provide for native support for attributes such as the OS/2 style attributes. Nevertheless, this functionality must be provided for OS/2 clients prior to the availability of such support for these attributes through DFS protocols.

The OS/2 client expects to attach standard file attributes (FAs) directly to a file. Moreover, OS/2 clients further expect to be able to retain additional information about files and directories in named entities known in the art as "extended" attributed (EAs). However, the OSF DCE DFS knows nothing about OS/2-specific FAs or EAs, and accordingly a need arose to accommodate such capability. However, an additional constraint on the system design was that such attributes must not be visible to the OS/2 DFS clients except through the normal OS/2 application programming interfaces. In other words, they must not be visible in the namespace which OS/2 DFS clients may access.

OS/2 extended attributes were implemented in the file allocation table (FAT) file system by storing all the EA data for a single OS/2 drive in a single file in the root directory of the drive. However, in addition to performance and accessing problems associated with a single file containing all EA data, the FAT solution was unworkable in DCE DFS environments because of security requirements. The DFS solution requires users to have the proper permission before accessing EA/FA data. This is true even if the user is on a non-OS/2 DFS system which does not support EAs. Grouping EA data from multiple users into a single file, as might otherwise be required without the invention, would render the provision for users to have proper permission unfeasible on a non-OS/2 system. Moreover, the single file concept, as previously noted, would give rise in many instances to the performance bottleneck noted when it is considered that hundreds and perhaps thousands of distributed file system users might need access to that single file at the same time.

The foregoing problems regarding the DFS file system not providing for native support for file and extended attributes such as those of the OS/2 operating system were addressed in our copending U.S. patent application Ser. No. 08/355,868 now U.S. Pat. No. 5,617,568 entitled "SYSTEM AND METHOD FOR SUPPORTING FILE ATTRIBUTES ON A DISTRIBUTED FILE SYSTEM WITHOUT NATIVE SUPPORT THEREFOR" and which is incorporated herein by reference.

Yet other problems, however, are presented by employing distributed file systems such as the aforementioned DFS with certain operating systems including the previously referenced OS/2 (TM) operating system.

DFS supports pathname syntax which differs from that of certain operating systems. This, in turn, presents problems for programmers porting DFS client code to such operation system platforms, e.g. how might a user of such operating systems be enabled to reference a file or directory of a distributed file system such as DFS using this unsupported syntax?

Some operating systems provide for installable file systems (IFS) to facilitate use of other file systems with the operating system as, for example, in the case of OS/2 operating systems. However, even with the addition of such a facility of IFS for a DFS client, only the pathname styles of the operating system itself will be recognized by the operating system.

Many file systems attach at the top of the system's file space. However, in the case of OS/2 and other file systems, if an attempt is made to attach at the top of the DFS tree, for example, the operating system user would have to deal with unfamiliar syntax of the file system, such as

It is therefore an object of the invention to facilitate an operating system user's ability to reference objects in a distributed file system having an incompatible namespace.

It is a further object of the invention to provide compatibility between DFS namespaces and operating system pathname syntax not supported in the DFS.

It is yet another object of the invention to facilitate a programmer's ability to port DFS client code to certain operating system platforms.

According to the invention, these objects are accomplished by first associating a DFS pathname prefix such as /. . . /cellname/fs with each drive letter that is attached to a DFS IFS driver, such as via the "dosFSATTACH" command in the case of the OS/2 DFS implementation.

Before an IFS driver is used, an application program issues a "dosFSATTACH" command in order to associate at least one OS/2 drive letter with that particular IFS driver. The "dosFSATTACH" command which is thereby issued also carries a DFS pathname prefix within a data buffer. The IFS driver services the "dosFSATTACH" command by validating the existence of the DFS pathname prefix, and thereafter stores such pathname prefix into an internal table where it is associated with the attached OS/2 drive letter.

All file system requests which are later received by the DFS client IFS driver, and which carry a pathname containing that drive letter, will have their file specifications edited by the DFS code prior to processing. The drive letter in the pathname is replaced by the DFS pathname prefix from the IFS driver's internal table. All backward slashes (".backslash.") in the OS/2 pathname are then converted to forward slashes ("/").

In this manner, the effect is to route OS/2 drive letters at particular points within the DFS namespace. The operating system user is thereby allowed to reference DFS objects relative to that point in the namespace, utilizing the operating system's pathname syntax that the user is comfortable with.

Whereas the embodiment just described is with respect to the DFS file system, the invention is not intended to be so limited and is thus applicable to distributed file systems generally having no name restrictions other than those of the POSIX IEEE 1003 standard and thus includes the aforementioned NFS file system.

Moreover, for convenience, when the acronym DFS has been used herein, the DCE DFS file system has been intended, whereas when the "distributed file system" term is herein utilized, the more general file systems thus described are intended.

The foregoing and other objects, aspects, and advantages of the invention will be better understood from the following detailed description of the preferred embodiment of the invention with reference to the accompanying drawings, in which:

FIG. 1 is block diagram of a typical individual computer site such as a PC or workstation forming a component of a DCE DFS environment in accordance with the invention;

FIG. 2 is a conceptual block diagram of the DCE computing environment architecture;

FIG. 3 is another illustration of the DCE architecture of FIG. 2 depicting the layered aspect thereof;

FIG. 4 is an illustration of the global nature of the DCE file system;

FIG. 5 is a block diagram illustrating a single image view of the DFS namespace;

FIG. 6 is a block diagram of a DFS client and server file server operation;

FIG. 7 is a block diagram illustrating how a DFS client locates a DFS server;

FIG. 8 is a block diagram illustrating a fully configured DCE DFS cell;

FIG. 9 is a block diagram illustrating extended attributes of a file;

FIG. 10 is a block diagram illustrating an OS/2 DCE DFS client structure;

FIG. 11 is an example illustrating how EAs would be stored;

FIG. 12 is a flow diagram illustrating the use of EAs to support file attributes on a distributed file system;

FIG. 13 is a flow diagram of a process implemented by a computer system in accordance with the invntion whereby a table is built correlating operating system drive letters and file system namespace syntax.

FIG. 14 is a flow diagram of a process implemented by a computer system in accordance with the invention for processing a file system request whereby compatibility is provided between distributed file system namespaces and operating system pathname syntax not otherwise natively supported in the namespace.

It will be noted that it was a feature of the invention disclosed in our copending U.S. patent application Ser. No. 08/355,868 entitled "SYSTEM AND METHOD FOR SUPPORTING FILE ATTRIBUTES ON A DISTRIBUTED FILE SYSTEM WITHOUT NATIVE SUPPORT THEREFOR" filed Dec. 14, 1994 now U.S. Pat. No. 5,617,568, to provide for file attributes for a particular operating system in a distributed file system environment which does not have native support for such attributes. In order to more fully understand the present invention, an understanding of attributes of files in an operating system may be helpful as a related instance of the problems which arise from commingling operating systems and file system each having differing characteristics such as syntax. Such attributes and provision for namespace compatibility will be discussed with respect to the OS/2 operating system. However, the invention is not intended to be so limited to a particular operating system, but rather may be readily generalized to handle and provide compatibility for many given operating systems on a distributed file system. Thus, the invention is not intended to be limited to the OS/2 embodiment herein illustrated.

For background and detail on the nature of attributes and, more particularly, extended attributes (EAs) and file attributes (FAs) as they relate to the OS/2 operating system, reference may be made to chapters 4 and 5 of the OS/2 2.0 Programming Guide, Vol. 1.

For present purposes, however, it will be appreciated that certain file systems such as the aforementioned OS/2 file system, maintain a standard set of information on file objects which typically includes the name and size of the file, date and time the file object was created, last accessed and last written to.

Applications may, however, attach additional information to a file object in the form of an extended attribute. There may be multiple EAs associated with one particular file object and, because of their flexibility, almost any information about the file may be stored in one. These EAs may be utilized to describe a file object to another application, to the operating system, and to the file system that is managing that object. The information contained therein may be utilized to store notes on file objects, (e.g. the name of the creator), to categorize file objects (for example, source, samples, icons, bit maps), to describe the format of data contained in the file object (for example a data record), or to append additional data to the file object.

An application uses extended attributes to provide a description of a file or directory. However the application may not actually place the description in the file or directory itself. Extended attributes associated with a file object are not necessarily part of the file object or its data. Rather, they may be stored separately from the file they are linked to and thereby referred to as being "attached", and the file system manages the storage and maintenance of such EAs.

The value of an EA may be text, a bit map, binary data, or the like. The operating system does not check data associated with an EA. The application which creates the EAs and the application that reads them must recognize the format and meaning of the data associated with a given EA name. Applications may examine, add, and replace EAs at any time. A file may have any number of EAs, as illustrated in FIG. 9. In the OS/2 implementation of EAs, each EA may be up to 64 KB in size, and the sum of all EAs for a file must not exceed 64 KB.

As an illustration of EAs, with further reference to FIG. 9, an illustrative file entitled "my.sub.-- file", 80, is shown having numerous EAs 82-94 with the associated names and values shown in Table 1.

So that EA data may be understood by their so applications, conventions have been established for naming EAs and indicating the type of data they contain. Such EAs associated with a file object may not be part of the file object or its data but rather are "attached" as will be hereinafter described.

Referring to Table 2 which follows, it will be apparent that in the OS/2 implementation EAs may contain any type of data as shown by the variety of data types 96 and associated descriptions 98. All user-defined data types are length-preceded, meaning that a word indicating the length of the data in bytes precedes the data. As an example, a representation of the ASCII string "Hello" would be as follows: EAT.sub.-- ASCII 0005 Hello.

Because many applications utilize text, bit maps, and other binary data in EAs, standard names have been adopted to identify such formats for a common set of standard EAs although applications are not limited to such EAs and may define their own application-specific EAs. Such standard EAs in the OS/2 convention have a dot as a prefix identifying the EA as a standard EA. The leading dot is reserved, so that applications should not define EAs commencing with a dot. Also, EAs commencing with the characters $, @, &, or + are reserved for system use. Standard EAs which have been defined include .ICON, .TYPE, .KEYPHRASES, and the like more fully described in the previously noted IBM programmer's manual.

Now that a description of DCE, DFS, and the EA and FA aspects of OS/2 have been described, a specific DCE DFS client/server system will be described in greater detail with reference to FIG. 10 in which the invention may be implemented in a preferred embodiment. It will be noted from FIG. 10 that the DFS client 96 is implemented executing the OS/2 operating system and the DFS server 98 is implemented employing the AIX (TM) Unix-based operating system of the IBM Corporation. It will also be noted that the client 96 employs the OS/2 installable file system facility well known in the art, thereby removing the need for intercepting file system calls at the user level or kernel level above and below line 100, respectively. The cache manager 102, which handles the manipulation of remote files on the local workstation disk, is implemented at the user level above line 100. A driver on the client machine 96 is attached to a DFS file system driver 104 in the kernel below line 100. An IFS file system request router 106 directs file system requests to the DFS FSD 104 if the requests are associated with the drive to which the DFS FSD is attached. The FSD 104 then routes the file system requests to the DFS cache manager. The OS/2 cache manager (CM) 102 has a file system request administrator (VENUS) in the user space to receive requests from FSD 104. VENUS, 102, in turn includes a pool of threads to process such file system requests. A thread will be allocated to a file system request received from the FSD 104. Such VENUS thread will invoke appropriate mapping routines in CM 102 to translate the FSD 104 requests into CM vnode operations acted upon by the OSF CM 104A through the network by means of the previously discussed client and server remote procedure calls (RPC) 106, 108, respectively.

Finally, with respect to FIG. 10, it will be seen that in the client implementation, conventional DOS or windows calls will be issued or received by user applications 110 executing in the client 96 space, such calls being passed between the user application 110 and the IFS file system request router 106.

Clients, such as those of OS/2 and AIX, typically expect files and/or directories to contain attributes previously described such as "Archive", "Hidden", "System", "Icon", etc. It will be recalled from the foregoing that these attributes indicate characteristics of the file or directory which may be required by an application. In such operating systems as OS/2 and AIX, their file systems are constructed so that the attributes are "attached" directly to the data as contrasted with the case of DFS herein described wherein there is no provision for such ancillary extended attribute data. Thus, the problem arises that if EAs and FAs may not be attached to a file directly (e.g. the norm in a file system) then how may such attributes associated with an operating system be attached and referenced in the context of another file system such as DFS having no native support for these attributes. In other words, in essence, FAs in OS/2 for example, are attached in part of the corresponding file, whereby when the file is moved, the FAs accompany it. This is not true in DCE for example, so that when a file is copied from a DCE server, heretofore the FAs or other attributes which may be crucial to the application would not accompany the file. Thus, a technique was needed for attaching these attributes in a DCE context.

Numerous other related problems have persisted. For example, when a "dir" is performed in OS/2 the user will see files in the directory but typically not related attribute files as a result of normal OS/2 APIs. In any implementation solving the problem of attaching attributes in DFS, it is highly desirable to retain this user convention of not displaying attributes unless explicitly commanded to do so, e.g. it was desirable that such attributes not be visible in the namespace which OS/2 DFS clients could access so that the OS/2 DCE user would see only what would be normally expected on a native OS/2 operating system and not the ancillary files which a typical OS/2 user would know nothing about. Thus, in summary, as a practical example of a typical problem created by current systems, when files copied from a native OS/2 file system (which supports EAs and FAs) are copied to a popular distributed file system such as NFS, which does not support such EAs and FAs, they get deleted. However, applications for example may require such attributes which will accordingly break if attempted to be run without their respective attributes.

One attempt to solve the problem was to attach attributes by internal file handles. When a file system is on line and active in DFS, such file handles on a server are meaningful and valid. However, it soon became apparent that their utility in attaching attributes was lost once the system was backed up which is typically done. Internal identifiers or file handles may be efficient, but once the DFS file system is backed up and taken off line, when brought back on line, such files and associated file handles get reassigned as the files are brought back in.

In other words, a file "X" might have a handle name "27" when the DES file system is backed up and brought back on line, it would however be assigned the next available internal number, (e.g. although we named it 27, after the server was backed up and brought on line the file might thereafter be designated "38", whereupon the server will no longer know, for example, about the previously identified file attribute).

Turning now to FIG. 11, a technique for storing attributes is illustrated by means of a representative example. It will be assumed a file "X" in directory "Y" 112 exists with a number of EAs 114, such as "icon", "ascii" and "type". For this file "X" in directory "Y" 112 in the DFS namespace for which EAs must be created, a subdirectory 116 is created in directory "Y" 112 such as .*OS2DFS.sub.-- EAs.

Next, a directory under the .*OS2DFS.sub.-- EAs subdirectory 116 is created shown at reference numeral 118 whose name is the file's name (X). Each of the EAs 114 associated with the file X will be placed under the "X" subdirectory 118, with each of the attribute names such as "Icon" being the file name under the /X subdirectory.

A departure in the description relative to FIG. 11 must now be made with respect to "critical" EAs. A field in an EA may be user-specified as being "critical". As to the significance of "critical" designations, applications for example may have to access an attribute and its associated file in order to perform some task where the application may fail. Thus, we must be able to identify quickly and inform the calling function whether the attribute is critical.

As an example, in the REXX language, command files in some cases are compiled to operate efficiently. Compiled versions are extended attributes attached to the command version. Instead of carrying two versions of a command file, a compiled binary is "attached" as an EA. If it is specified that all REXX command files are desired to run an application, which would thus include the compiled version of commands, such commands would be "critical" to the application, e.g. if not attached, the application calling for them could not execute.

With the foregoing in mind, returning now to FIG. 11, if an EA is determined to be critical, it will be so marked by preceding its file name with a "?". For example, a conventional non-critical EA with an attribute name of "ICON" may be seen in FIG. 11 stored as a file name "ICON". However, an EA which might be deemed critical, such as "TYPE", would be indicated as "?TYPE" as also shown in FIG. 11. It will be noted that OS/2 extended attribute names must follow the same conventions as OS/2 file names, and therefore "?" and "*" are not valid for use in names on OS/2.

EA file naming in accordance with the invention becomes more complicated when EA names reach a maximum length. One assumption is that the maximum length attribute name case (with collisions) is seldom if ever going to happen. If the attribute name is the maximum length (for example, 256 characters), then the first two characters of the attribute name will be replaced with a "??". The original name of the attribute will be stored in the file header. Thus, whenever a file name is encountered with a "??" at the beginning, this is a signal to the DFS to look in the file header for the original name of the attribute. Because the original unique attribute name has been changed of course, a possibility arises of file name collisions. For example, two critical EAs with attribute names "A------maxlength . . . " and "B------maxlength . . . " would both have file names of "??----maxlength . . . ". Such potential collisions will therefore be resolve by adding another "?" to the file name. Thus, in the foregoing example, the second EA would have a file name of "???--maxlength . . . "

Continuing with the example of FIG. 11, operating systems such as OS/2 may provide for many EAs per file. When performing a "dir" function in OS/2, the corresponding call goes through the API and queries the file system for each file to determine the file size and size of the EAs. In the implementation being herein described, it was undesirable to read all file headers for EA critical status, and size, and accordingly this information was pulled out for all EAs and cumulated or placed in a single file, thereby providing a performance benefit. Thus, in summary on this point, in order to provide efficient access to the total EAs size and number of critical EAs for a file, an additional file 120 is created for each file such as file X and placed under the .*OS2DFS.sub.-- EAS/X directory. This file will have a form and be named *N*C, wherein N is the total size in bytes of all the EAs and C is the number of critical EAs for the file. Once again, the "*" at the beginning of the name is used to prevent conflict with EA names.

Using the example of FIG. 11, it will be noted that the file 120 includes a number "70" followed by a number "1". The 70 will be seen to be the sum of the sizes of the attributes ICON, ASCII, and ?TYPE, e.g. 10+40+20. The "1" indicates that the number of critical for file "X" is 1, e.g. the ?TYPE critical EA.

In like manner, a subdirectory/Z might be included under the directory 116 for all file "Z" EAs shown at reference numeral 122, with the EAs therefor shown at 124.

It will be appreciated that EAs may be attached to directories as well as files. In the example given in FIG. 11, the illustration would be essentially the same if "X" was a directory rather than a file. Furthermore, attaching EAs to the root directory is the only exception to the scheme described in FIG. 11. The directory .*OS2DFS.sub.-- EAs will be created in the root itself since there is not a parent directory.

It will be noted that the directory name such as .*OS2DFS.sub.-- EAs is inpermissibile in OS/2 applications. The OS/2 kernel will not permit this across the file system API, but will try to substitute something for the asterisk and will be unable to find any matches but the asterisk itself. This is to be contrasted with, and thus very unlike, the Unix model, where the file system will accept any value for a name, and the various shells are responsible for metacharacter substitutions. In effect, what is being accomplished is the hiding of EAs and FAs in an opaque part of the DFS namespace, at least as far as OS/2 applications and users are concerned. This directory wherein the EAs reside is thereby only "semi-visible" to Unix users. The ameliorating circumstance is that it appears like an application configuration file that even novice Unix users tend to not access or alter. The directory will not be visible because it starts with a ".", unless the Unix user specifically requests that it be seen. Even then, however, DCE DFS provides security support requiring a user to have the proper permission before being allowed to access to a file or directory. This security support has been extended for EA/FA data and files. It requires the same permission to access EA/FA data as is required to access the file to which the EA/FA data is associated. Even if the Unix user has requested viewing of the directory, no user data is visible unless the user would also be able to access the data as an OS/2 user.

Turning now to FIG. 12, depicted therein is a flow diagram of how a system such as that of FIG. 10 might employ the EA filing technique beneficially which was just described with reference to FIG. 11.

First it will be assumed that an application has made a call for a "dir" function which may include a need to know how big the file is, and information regarding the EAs and FAs attached thereto. The OS/2 operating system would examine the call, and detect that it related to a file in the file system managed by DFS by means of the DFS file system driver, whereupon it is necessary to process the request. This information request about attributes is shown at block 126.

The system would then query at 128 whether the previously described .*OS2DFS.sub.-- EAs directory exists. If not, the left branch is executed, indicating at block 130 that no EAs are attached to files in the file system. Consequently, a query for size and/or query for whether critical EAs exist corresponding to the file name "X" will return 0, shown at 132. If, on the other hand, the directory in response to decision block 128 is determined to exist, flow exits to the right to a next decision block 134. At block 134, a query is made as to whether a subdirectory/X having the same name as the file name (X) exists. If not, the flow exits the left path from block 134 indicating as shown at block 136 that EAs are attached to some files in the file system but not file "X", whereupon a 0 is returned, 138.

If on the other hand, in response to the decision block 134 it is determined that such a subdirectory/X exists, flow exits to the right of block 134, whereupon files in the subdirectory/X are read, 140.

Next, a determination is made at decision block 142 of whether the size of the EAs or critical status has been queried. If not, the EA files (ICON, etc.) are simply read and passed back to the caller, 144. If, on the other hand, the size and/or critical status of EAs has been requested, flow exits to the right of block 142 whereupon the parameter *n*c is returned at block 146. It will be recalled that the "n" in the parameter provides the desired EA size and the "c" provides the count of critical EAs associated with the /X subdirectory. Control is thereafter returned at block 148.

Now that a description of storing and utilizing stored EAs in accordance with the invention has been made, attention will focus to the related problem of supporting file attributes, FAs. It will be recalled that OSF DCE DFS also does not have native support for OS/2 file attributes, yet this functionality must, in like manner to EAs, be provided for OS/2 clients prior to any future availability of support through DFS protocols. This function will be provided as follows with reference to Tables 3 and 4.

For OS/2 FAs having similar semantics to existing DCE DFS file attributes, existing DCE. DES fields and interfaces will be utilized to access and represent the particular attribute. The OS/2 FAs "Hidden", "System", and "Archive" apply only to OS/2 DFS users and will be represented using the schema hereinafter described.

For a file "X" in directory "Y" in the DFS namespace for which OS/2 FAs must be created, a directory ".*OS2DFS.sub.-- FAs" will be created in directory "Y". Similarity to directory 116 in FIG. 11 with respect to EAs will be noted. Also similar to the approach of FIG. 11, the FA's attributes will be represented by a file under .*OS2DFS.sub.-- FAs. The file will be named "FILENAME*V" where "FILENAME" is the target file's name without a path, and "V" is a value representing the file's OS/2 attribute settings. It will be noted that because of size restrictions, the values for V are not directly mapped to the OS/2 attribute values. In other words, an internal table is provided indicating what the value means. For example a "6" could correspond to a "Hidden" value of 4 and "System" value of 2.

When initially creating FAs, if the FA values requested by the caller match the defaults shown in Table 3, then no FA directories or file will be created. When searching for a file's FAs and no FA directories or file is found, then the default FA values will be assumed, shown in the right column of Table 3.

Shown in Table 4 is a representative example indicating how such FAs will be stored. It will be assumed that a file "X" in directory "Y" exists with FAs of "Hidden" and "System". The first line of Table 4 indicates the representation of file "X" in directory "Y". The second line of Table 4 indicates the subdirectory which contains all FAs for directory "Y". Finally, the third line of Table 4 indicates a file "X*6". From the foregoing, it would be apparent that this indicates that the FAs "Hidden" and "System" exist, as designated by the 6, for file "X".

FAs may also be attached to directories. The example with reference to Table 4 would be the same essentially if "X" was a directory. Also, attaching FAs to the root directory is the only exception to the scheme described above as is the case with EAs. The directory .*OS2DFS.sub.-- FAs will be created in the root itself since there is no parent directory.

The components of a representative computer system such as a PC or workstation in which the invention may be implemented will be described which may be utilized by a user as part of a component of the system of FIG. 10.

The clients and servers described herein may be preferably implemented with workstations such as an IBM.RTM. RISC System/600.RTM. computer. A representative hardware environment is depicted in FIG. 1 which illustrates a typical hardware configuration of a workstation in accordance with the subject invention having a central processing unit (CPU) 10A such as a conventional microprocessor, and a number of other units interconnected by a system bus 12A. The workstation shown in FIG. 1 includes a random access memory (RAM) 14A, read only memory (ROM) 16A, and I/O adapter 18A for connecting peripheral devices such as disk units 20A to the bus, a user interface adapter 22A for connecting a keyboard 24A, mouse or other pointing device 26A, speaker 28A, microphone 32A, and/or other user interface devices such as a touch screen device, etc. to the bus. The system further includes a communication adapter 34A for connecting the workstation to a data processing network, and a display adapter 36 for connecting the bus to a display device 38A. The workstation has resident thereon an operating system such as the IBM AIX.RTM. operating system.

FIG. 14 illustrates a flow diagram of code to be implemented on the systems of FIG. 1 and 10 for handling file system requests in accordance with the invention.

First a high level of an implementation of the invention will be provided, followed by a more detailed description with reference to FIGS. 13 and 14.

DFS supports a pathname syntax as follows:

Further detail regarding naming conventions in DFS and DCE cells may be found on page 7 of the "DFS for AIX/6000" publication and on page 32 et seq of the "Understanding DCE" publication hereinbefore referenced.

It will be appreciated that this pathname syntax is substantially different from that of the pathname syntax supported by other operating systems such as the OS/2 operating system. Accordingly, a serious problem was presented for programmers who were involved in porting the DFS client code to such an operating system platform. More specifically, the problem presented was how an operating system user of, for example, OS/2, would be able to reference a file or directory utilizing this unsupported syntax.

A conventional mechanism for supporting new file system types has already been discussed with reference to the mechanism in OS/2, namely the provision for an installable file system (IFS). This mechanism was discussed with reference to FIG. 10 and, in particular, the IFS file system request router 106 thereof. Even with the addition of such a facility as IFS on a DFS client, only OS/2-style pathnames continue to be recognized by the OS/2 operating system. The solution offered to this problem by the present invention was to associate a DFS pathname prefix (e.g./ . . . /cellname/fs) with each drive letter that is attached (via an appropriate command such as the "dosFSATTACH").

Before an IFS driver can be used, an application program must issue such a command as "dosFSATTACH" to associate at least one driver letter from the operating system such as OS/2 with that particular IFS driver. The command such as "dosFSATTACH" which is issued to the DFS client IFS driver also carries a DFS pathname prefix within a table defined in a data buffer. The IFS driver services the "dosFSATTACH" by validating the existence of the DFS pathname prefix and storing the pathname prefix into the previously mentioned internal table in the buffer, where it is associated with the attached OS/2 driver letter.

All file system requests which are later received by the DFS client IFS driver and which carry a pathname containing that drive letter will have their file specifications edited by the DFS code prior to processing. The drive letter in the pathname is replaced by the DFS pathname prefix from the IFS driver's internal table. All backward slashes in the OS/2 pathname are then converted to forward slashes.

It will be appreciated from the foregoing that the effect of the invention is to route the OS/2 driver letter at particular points within the DFS namespace. Moreover, the invention thereby permits the OS/2 user to reference DFS objects relative to that point in the namespace, utilizing the OS/2 pathname syntax that the user is most comfortable with.

Many file systems attach at the top of the file space, however this is not the normal way in which the OS/2 and other operating systems use the available space. In accordance with the invention, multiple drives may be provided and, for example, a drive may point to the top of the file space. However in accordance with the invention it may be mounted further down in the namespace wherever desired. In operation, a user, for example, might enter a D: in order to switch to the D drive. A call would then be intercepted by the file system request router 106 (FIG. 10) originating from the application 110. This call signifies the desire to attach the drive D to a certain position in the file space. The operating system would normally be trying to attach a path to a file system to a drive letter whereby normally the entire file space would get attached to the drive D. In DFS, that would of course be the entire DFS file system if attached at the top of the tree. Normally, however, with the large file systems provided by DFS, the desire in fact may to attach down in the tree. Accordingly, instead of attaching at the top, when such a request is routed to the DFS file system driver 104 of FIG. 10, a table is kept in accordance with the invention of where the user actually desires to attach.

Therefore, it is a feature of the invention to store, for a particular drive, the location in the DFS namespace where it is desired that the D: drive be attached. The next time a request is received for a drive, it is not simply assumed that what is desired is the location at the top of the DFS namespace. The aforementioned table is therefore utilized to decide where to route the request within the DFS namespace.

As previously discussed regarding the problem addressed by the invention, it will be recalled that with respect to OS/2 operating system user or the user of other operating systems, such a user may not be conversant and comfortable with a distributed file system syntax such as that of DFS. If the user were attached at 25 the top of the DFS tree, he or she would have to deal with the "/ . . . " and other unfamiliar syntax. Accordingly, in accordance with the invention, it permits the user to attach further down on the tree by means of the table retained in the client 96. When a request is received for a file on a drive, this request is converted from a drive-oriented request to the DFS namespace syntax before it is routed to the server shown at reference numeral 98 of FIG. 10. This conversion is performed in the DFS file system driver 104 wherein the lookup table resides. Thus, by the time the request is routed to the right side of the diagram of FIG. 10 to the server 98, the client name has been transformed to the corresponding DFS name and then transported to the server. When a drive is to be attached, a request for such action indicates the drive to be attached and what is desired to be attached to it. In the case of a LAN server, for example, this would include the domain or server name; in the case of the NFS file system, a mount point, and in the case of DFS, a string utilizing DFS syntax. Such a request must be "validated" by determining if the specified pathname exists, e.g. in the case of the LAN, verifying the server is there, or, in the case of DFS, determining whether a valid point in the namespace has been specified. The pathnames thus specified in accordance with the invention are tracked in an internal table. More particularly, the pathname prefix specified in a request to attach a drive is associated with that drive letter and retained in the table. In this manner, when a user references a particular drive letter, the internal table has retained the original request. Once the table is thereby established, all file system requests received by the IFS driver which carry the pathname that has the drive letter will be modified before processing. In other words, the drive letter in a request will be modified before further processing by the server whereby the drive letter is replaced by the pathname prefix previously saved in the internal buffer. In this manner, every time the drive is referenced in a path, it will be modified based upon the contents of the internal table for that drive to be an actual DFS path instead of the conventional drive syntax of the operating system.

With the foregoing in mind, turning now to FIG. 13 and 14, these flow diagrams may be more readily understood. First, regarding FIG. 13, this is an illustration of a flow diagram of program code in accordance with the invention to be implemented whereby the previously noted internal table is constructed. First, it will be assumed that an appropriate user application 110 of FIG. 10 has issued a "dosFSATTACH" or like command to a DFS client IFS driver to be routed by the router 106. The purpose of such a command is to associate one or more OS/2 drive letter such as, illustratively, driver letter "X" with a particular IFS driver. The "dosFSATTACH" command thus carries the DFS pathname prefix.

Upon the request being generated to associate the drive letter with the IFS driver, 150, the process then performs a check of whether the DFS pathname prefix in the request is valid, 152. If not, the routine ends, 156. If, on the other hand, when the IFS driver services the DOS attach command, the IFS driver has validated existence of the DFS pathname prefix (e.g. verified that a valid point in the file system namespace exists), the process exits the left branch from box 152. At this point, the pathname prefix corresponding to the request is stored in a table in an internal buffer in the DFS file system driver 104. This prefix is stored in the table associated with the corresponding attached OS/2 drive letter "X" by the client 96. The purpose for doing this is that when the user references the particular drive letter again, there is an internal table containing what was originally asked for which may be thereafter utilized once the table is established in the manner of the invention.

After the table has been established, turning now to FIG. 14, there is illustrated a flow diagram of code in an implementation of the invention which would take advantage of this feature in processing a file system request. More specifically, referring to FIG. 14, it will first be assumed that a file system request has been generated, 158, from an application 110 for a file on a particular drive whereby this drive is referenced in a path. After generating the request 158, it is received by the DFS client IFS driver 106, shown at box 160. Next, a check is made to determine if the request carries a particular pathname containing the drive letter "X" shown at box 162. If not, the routine ends, 166. If, on the other hand, the check in box 162 reveals that the pathname is present in the request, the process exits to the left of box 162, whereupon the file specification is modified or edited by the DFS code before further processing, shown at box 164.

This process of modifying or editing the file spec is essentially the step of transforming the client name of the request to the DFS name before it is transported to the server side 98 of FIG. 10. This is done by replacing the drive letter in the request by the pathname prefix previously saved in the internal buffer, which is the actual DFS path rather than the conventional drive syntax. As shown by the dotted lines in FIG. 14, the more detailed steps effected in such editing are shown in such alternate path. Specifically, the previously appropriate entry therein, the drive letter in the generated table in accordance with FIG. 13 is searched, shown at block 168. In response to location of an pathname "X" is replaced with the DFS pathname prefix from the IFS driver's internal table, block 170. Finally, the back slashes in the operating system pathname in the request are converted to forward slashes 172, whereupon further processing of the request by the server is permitted as shown at block 174.

While the invention has been shown and described with reference to particular embodiments thereof, it will be understood by those skilled in the art that the foregoing and other changes in form and detail may be made therein without departing from the spirit and scope of the invention.