US 5,598,562 AGrant
System and Method for Adding New Waitable Object Types to Object Oriented Computer Operating System
Issue Date:1997-01-28
•24 Claims
•18 Drawing Sheets
Abstract
An object based operating system for a multitasking computer system provides objects which represent the architecture or interrelationships of the system's resources. Access to certain objects is required in order to use corresponding resources in the system. All objects have a consistent data structure, and a consistent method of defining the operations which apply to each type of object. As a result, it is relatively easy to add new types of system objects to the operating system. Waitable objects are used to synchronize the operation of one or more processes with one another or with specified events. The system provides routines for generating new types of waitable objects, and thereby generating a modified operating system, without modifying other aspects of the operating system's kernel.
Metadata
Assignee
- Digital Equipment Corporation
Inventors
- David N. Cutler
- James W. Kelly, Jr.
- Frank L. Perazzoli, Jr.
Application Information
Application Number:US 2050250
Filing Date:1994-03-01
Priority Date:1989-06-29
Art Unit:236
Classifications
IPC:
G06F 946
Field of Search:
395650;700
Patent Drawings (18 sheets)
Description
The present invention relates generally to multitasking digital computer systems and particularly to methods and systems for managing the data structures used by a multitasking digital computer system.
BACKGROUND OF THE INVENTION
Large computer systems generally allow many users to simultaneously use a single computer's resources. Such systems are herein called multitasking digital computer systems. Such computers include virtually all mainframe computers and most minicomputers.
One of the primary jobs of the operating system for a multitasking computer system is to support and keep track of the operations of a multiplicity of users who are running numerous concurrent processes. Thus the computer's operating system must have data structures which represent the status of each user. Such status information includes the memory and other resources being used by each user process.
If every user process were completely independent, had its own dedicated resources, and there were no concerns about which resources each process could use, operating systems could be relatively simple. However, in actuality, computer resources are shared and many user processes need to access commonly used or owned resources. In fact, each user may generate a number of execution threads which run simultaneously and which need to be able to share resources and to communicate with other ones of the user's threads.
Another concern in multitasking computer systems is security and data integrity. Ideally, the computer system should provide an access security system which enables each user to control the extent or amount of sharing of information that belongs to the user. Further, the system should provide several types of protection. For example, when multiple processes are allowed access to a resource, the identity of each process which attempts to access the resource should be tested to determine if that particular process is authorized to access the resource. The system of access control should also provide limited "visibility" of computer resources so that an unauthorized user cannot obtain information about another user by repeated attempts to access resources with various names. In addition, to protect data integrity, the system must protect against simultaneous accesses by different authorized processes.
Yet another concern of multitasking operating systems is clearing the system of "objects" (i.e., files and data structures) which are no longer needed by any of the systems users. Ideally, the system should also be able to automatically deallocate resources, such as input/output devices, no longer needed by a process.
SUMMARY OF THE INVENTION
In summary, the present invention is an object based operating system for a multitasking computer system. The present invention, which is also called an object based architecture, is "object based" because it provides objects which represent the architecture or interrelationships of the system's resources. The present invention provides an extensible, yet rigorous framework for the definition and manipulation of object data structures.
Objects, generally, are data structures which store information about the user processes running in the system, and which act as gateways to using the system's resources. Resources, generally, include sets of information, physical devices such as a tape drive, and various programs or "operations". Such resources are not available to a user unless the user has explicit permission to use that resource. More specifically, access to certain objects is required in order to user the corresponding resources of the computer system.
All system objects have a consistent data structure, and a consistent method of defining the operations which apply to each type of object. As a result, it is relatively easy to add a new type of system object to the operating system, or to change an existing system object.
Another feature of the present invention is a multifaceted access control system. The object based operating system of the present invention supports multiple levels of visibility, allowing objects to be operated on only by processes with the object's range of visibility. This allows objects to be made private to a process, shared by all processes within a job, or visible to all processes within the system.
In addition to visibility control, access to each object is controlled through an access control list which specifies the processes authorized to access the object, and the types of access that are allowed. An object with a restricted access control list can be associated with a "privileged operation", thereby restricting use of the privileged operation to those user processes authorized to access the corresponding object. An object can furthermore be allocated to a specified job or process to protect the object from use by others, thereby denying access by otherwise authorized processes.
Yet another feature of the present invention concerns "waitable objects", which are objects used to synchronize the operation of one or more processes with one another or with specified events. The present invention provides routines for generating new types of waitable objects without modifying the operating system's kernel. More particularly, a set of several different types of predefined kernel synchronization primitives can be embedded in user defined objects, thereby enabling ordinary programmers and system users to define and generate waitable objects.
BRIEF DESCRIPTION OF THE DRAWINGS
Additional objects and features of the invention will be more readily apparent from the following detailed description and appended claims when taken in conjunction with the drawings, in which:
FIG. 1 is a block diagram of a computer with a multitasking operating system.
FIG. 2 is a block diagram of the virtual memory spaces of several concurrently running user processes.
FIG. 3 is a block diagram showing how data structure objects in the system are organized in a three level hierarchy.
FIG. 4 is a block diagram showing the hierarchical relationship between a user object, a job, the processes for a job, and the execution threads for a process.
FIG. 5 is a block diagram showing the range of objects visible to a particular execution thread.
FIG. 6 is a block diagram of the container directory and object container data structures at one level of the three level hierarchy shown in FIG. 3. FIG. 6A is a more detailed diagram of the process level container directory for a process.
FIG. 7 is a block diagram of an object ID.
FIG. 8 is a block diagram of the data structure of an object.
FIG. 9 is a block diagram an object type descriptor.
FIG. 10 is a block diagram of the process for adding a new object type to the system by creating an object type descriptor for the new object type.
FIG. 11 is a block diagram showing the reference pointers for a specified object.
FIG. 12 is a flow chart of the process for creating a reference ID for a specified object.
FIG. 13 is a flow chart of the process for deleting an object ID.
FIG. 14 is a flow chart of the process for transferring an object from one object container to another object container.
FIG. 15 is a flow chart of the process for transferring an object container to a specified container directory.
FIG. 16 is a flow chart of the process for conditionally creating a specified object.
FIG. 17 is a block diagram of the access control list for an object and a execution thread which is attempting to access the object.
FIG. 18 is a block diagram of the data structures for privileged operation objects.
FIG. 19 is a block diagram of the data structures for allocating a set of objects to a thread, process, job or user.
FIG. 20 is a block diagram of the data structures for implementing user defined waitable objects.
DESCRIPTION OF THE PREFERRED EMBODIMENT
Referring to FIG. 1, a computer system 100 in accordance with the present invention includes a high speed central processing unit (CPU) 102 which concurrently runs several processes 104-110. The CPU 102 may be either a single powerful processor or may contain multiple processors. As is standard in multitasking computer systems, each process has its own virtual memory space which is mapped partially into high speed primary memory 112 and partially into lower speed secondary memory 114 by a virtual memory manager 116. More generally, each process 104-110 is allocated a certain portion of computer's resources, including selected peripheral devices such as terminals 120-122 and other input/output devices 124 and 126. Other types of resources which are allocated to selected ones of the processes include specified sets of data and data structures in the system's memory 112-114.
The set of software which controls the computer's operation and the allocation of resources to the processes 104-110 running the computer is called the operating system 130. For the purposes of the present discussion it can be assumed that the operating system 130 is resident in primary memory 112, although certain infrequently used portions of the operating system may be swapped out to secondary memory by the memory manager 116.
One feature of the present invention is that the computer system 100 can serve as a "computer server" to one or more client computers 132. Client computers 132, coupled to the CPU 102 by a bus interface 134, can send tasks to the computer system 100 for execution. The computer system 100 is a mainframe or other high performance computer system which can execute tasks in a relatively short period of time compared to the client computers 132. The operating system 130 of the present invention includes a mechanism for setting up a process in the computer system 100 which adopts the "profile" or characteristics of the process in the client computer which is being served.
Referring to FIG. 2, there is shown a block diagram of the virtual memory spaces of several concurrently running user processes 104-108. The virtual memory space of every process includes a portion 140 which can be accessed by "user mode" programs as well as "kernel mode" programs, and a portion 142-144 which can be accessed only by "kernel mode" programs. The kernel mode portion 142-144 includes two sets of software called "the kernel" 142 and "the executive" 144.
As shown in FIG. 2, the portion of the virtual memory space which comprises the kernel mode portion 142-144 is common to all user processes running in the computer system. In other words, a predefined portion of the address space of every user process is occupied by the operating system 130 and its data structures. The user mode portion of each user process 140 occupies a distinct virtual memory space.
"Kernel mode" is a mode of operation used only by kernel and executive software routines. Only kernel mode routines can access the data structures used to control the operation of the computer system and to define the system resources allocated to each user process.
When a user mode program 145 in a user process 104 creates an object, or performs any one of a number of operations on an object, the user process calls a kernel mode routine 146 in the kernel mode portion 142-144 of its address space to perform the necessary operations. When the kernel mode routine 146 completes the necessary operations on the kernel mode data structures, it returns control to the user mode program 145.
The kernel 142 is the "lowest layer" of the operating system 130 which interacts most directly with the computer's hardware 148. The kernel 142 synchronizes various activities, implements multiprocessing capabilities, dispatches execution threads, and provides services to device drivers for handling interrupts.
The executive 144, which also runs in kernel mode, implements system services, memory management, user-level object support, the computer's file system, network access, and device drivers. The executive defines "system policy", such as the rules which govern the visibility of user accessible objects.
Object Architecture
The object architecture of the present invention is a set of data structures and procedures which controls the use of user definable objects.
GLOSSARY
To clarify the following discussion, the following definitions are provided.
"Objects" are data structures used to hold information that is used by the operating system and which must be protected from unauthorized access by users of the system. While users cannot themselves "define" objects, they can ask the operating system to create specified objects on their behalf. The resultant objects are system data structures that are accessible by the user through system routines which protect the integrity of those objects. For instance, a "process object" is a type of object used in the present invention to store the information needed by the operating system to keep track of the status of a particular user process. "User accessible objects" are objects used by user processes, and will be referred to herein simply as "objects."
"Kernel objects" are a distinct set of data abstractions used by the system's kernel and are called kernel objects in order to distinguish them from the regular objects which are part of the object architecture of the present invention.
A "user" is herein defined to mean a person or other entity recognized by the computer system as being authorized to create processes and to use resources in the computer system.
A "job" represents the current set of system resources being used by a particular user.
A "process" is the entity to which a virtual memory address space is assigned, and is the entity to which process-level objects are assigned. There can be multiple processes in a job. Whenever a job is created, a "top level" process is created for that job. Any process, including the top level process, can cause the creation of additional processes, called subprocesses or child processes. Any process which creates another process is referred to as a parent process.
A "thread", also called an "execution thread", is the entity which actually executes programs and thus provides a stream of execution (sometimes called a context state). It is the schedulable entity which executes program steps and consumes resources. More technically, a thread is a system defined object that executes a program that is resident in a process's address space. A thread contains a machine state that consists of the computer's register contents, a program counter, and other privileged information needed to cause the thread to execute a program. Each process many create a number of execution threads which run "simultaneously" and which can share resources and communicate with one another. Multiple threads can run simultaneously when multiple CPUs are available. On a single CPU system the operating system makes the threads appear to run simultaneously. All resource limitation data structures for a thread belong to the thread's process.
An "object container" is a data structure for storing pointers to objects. It is essentially a table which is used to keep track of a set of objects.
A "container directory" is a data structure for storing pointers to a set of object containers. Thus a container directory is a table used to keep track of a set of object containers.
OBJECT HIERARCHY
Referring to FIG. 3, the object architecture of the present invention provides a hierarchical "visibility structure" for objects. When an object is "visible" to a particular extension thread or process it means that the execution thread may at least attempt to access that object. Objects not visible to a process are stored in such a way that the process cannot even attempt access.
When an object is created, it is placed at one of three levels: the system level 160, the job level 162, or the process level 164. At the system level 160 there is a single container directory 170 which contains a set of system level object containers 172, 174, 176. Objects 178-180 in system level containers are visible to all threads on the system.
At the job level 162 there is a container directory 190 for every job that is currently active in the system. Each job level container directory 190 contains a set of job level object containers 192, 194, 196. Objects at the job level 162 are visible only to threads in that job.
At the process level 164 there is a container directory 200-206 for every process that is currently active in the system. Each process level container directory 200 contains a set of process level object containers 212, 214, 216. Objects at the process level 164 are visible only to threads in that process. For example, a thread cannot access an object that is at the process level for another process. As will be explained below, this visibility restriction is achieved by giving each process a pointer, called an object ID, only to its own process level container directory. Because a process cannot have a pointer to the process level container directory for other processes, each process is incapable of "expressing" the object ID of objects in the containers not visible to that process.
Each process is assigned at least two process level object containers 212 and 214. The first object container 212 is called the public display container for the process and the second container 214 is called the private container. Only objects that the process wants to be accessible to subprocesses are placed in the public display container 214, and all other objects created by the process are put in its private container 216.
Referring to FIG. 4, there is a hierarchy of objects which represents users, jobs, processes and threads. FIG. 4 shows the hierarchical relationship between the objects for a user, a job, the processes for a job, and the execution threads for a process.
As shown, there are four levels of objects in the User-Job-Process-Thread (UJPT) hierarchy, and each type of object is stored in a corresponding system level object container 220, 222, 224 and 226. All user objects 230 are stored in a user object container 220. Job objects 232 are stored in a job object container 222. Process objects 234 and 236 are stored in a process object container 224, and thread objects 240, 242 and 244 are stored in a thread object container 226.
The four levels of objects provide a logical grouping of functionality and control. A user object 230, which appears at the highest level of the User-Job-Process-Thread (UJPT) hierarchy, defines the security profile and resource quotas/limits for its underlying objects. The user object 230 also stores a pointer to the job object 232 for the user.
A job object 232 provides a job level container directory and a set of resource limits for a collection of processes running as a job. The job object 232 includes a reference pointer to its user object 230, and a list head which points to the first process object 234 for the job. Thus the process objects 234-236 for a particular job are accessed as a linked list. Note that in FIG. 4, linked list pointers are depicted as narrow lines with arrow heads which point either down or to the right within the hierarchy, while reference pointers are depicted as thicker lines with arrow heads that point upwards in the hierarchy.
A process object 234 provides a process level container directory, a pointer to the page table for the process, and pointers to the parameters needed to manage the address spaces of its execution threads. The process object 234 includes a reference pointer to its job object 232, and a list head which points to first thread object 240 for the process. The thread objects 240-242 for a particular process are accessed as a linked list. The process object 234 also contains a list head which points to the first subprocess for which the object 234 is the parent process (not shown in FIG. 4).
A thread object 240 contains a thread control block which stores the processor state as its executes the steps of a program, including the pointers and values needed to keep track of all resources used by the thread object. The thread object 240 includes a reference pointer to its process object 234, and a list pointer for joining additional thread objects into a linked list of threads for the process.
FIG. 5 is a block diagram showing the range of objects visible to a particular execution thread. In particular, each thread object contains a thread control block 250 which points to the software process control block 252 for the thread's process. The software process control block 252 contains pointers which indirectly point to a container directory at each of three visibility levels. The container directory 170 at the process level is the container directory belonging to the process object for the thread. Similarly, the container directory 190 at the job level is the container directory belonging to the job object for the thread. The system level container directory 200 is the same for all threads.
MUTEXES
Access to each and every container directory is governed by a corresponding mutex. A mutex is essentially a flag used to synchronize access to a corresponding system resource. The purpose of a mutex is to ensure that only one thread accesses a particular resource at any one time. To use a resource that is protected by a mutex, one must first "object the mutex". Obtaining a mutex is an atomic (i.e., uninterruptable and interlocked) operation in which the mutex is tested. If the mutex was previously set, the process trying to obtain the mutex is suspended until the mutex becomes free. If the mutex is free, it is set and the requesting process is then allowed to access the protected resource.
Mutexes are used throughout the present invention to synchronize access to container directories, object containers, linked lists of objects, and many other types of data structures. For instance, to change certain fields of an object, the thread making the change must first obtain the mutex for the container in which the object is located. In addition, many objects contain a mutex which protects that object.
All mutexes used by the system are stored in an array 254 in a non-paged, protected portion of primary memory, accessible only to kernel mode routines, which cannot be swapped out by the memory manager. The "mutexes" shown in many of the data structures in the Figures are actually pointers to the corresponding mutexes in the mutex array 254. In other embodiments the mutexes need not be stored in an array so long as they are stored in non-paged, protected memory.
As will be explained in more detail below, in the section entitled Waitable Objects, mutexes are a special type of kernel synchronization primitive.
As shown in FIG. 5, there is a mutex for each of the three container directories which are visible to a particular thread.
CONTAINER DATA STRUCTURES
Referring to FIG. 6, there is shown a portion of the data structures for one container directory 260 and one object container 262. For the purposes of this discussion, the container directory and object container data structures may be at any level of the three level hierarchy shown in FIG. 3.
The data structures for container directories and object containers are virtually identical. For the sake of clarity, the data structure for an object container will be explained first.
An object container 262 comprises a container object 270, which contains a standard header 272, a pointer 274 to a name table 275, and a pointer 276 to an object array 280. The purpose of the name table 275 is to translate object names into object IDs, and the purpose of the object array 280 is to translate object IDs into pointers to objects 281. The object container also includes a container mutex 278 which is used to synchronize access to certain fields in the name table 275, the object array 280, and the objects in the container.
The name table 275 has two portions, an object name array 282 and an array of name definition blocks 284. The object name array 282 is simply an index into the array 284 of name definition blocks and may be implemented as either a hash table or a binary tree. In either case, each entry in the name array 282 contains one object name and one pointer to an entry in the array of name definition blocks 284. Each name definition block 286 contains information for one object name, including the object ID as well as the object's type (object types are described in more detail below) and mode (i.e., accessible by user mode or kernel mode routines).
The object array 280 contains an array size value 288 which denotes the size of the array 280, which corresponds to the maximum number of object points that can be stored in the object array 280. The object array has a set of elements 290-294, each of which can store either an object pointer or a place holder for an object pointer. The count value field 296 denotes the number of elements in the object array which currently hold object pointers (i.e., the count value is equal to the number of object pointers currently stored in the object array 280).
Array elements such as element 292 which store a place holder are said to be "free". These unused elements are arranged in a singly linked "free list", the head of which is the "next free" link head field 298. The unused elements 292 in the object array contain a "sequence number high" field and a link to the next free element in the object array. The link fields in the unused elements form a list of unused object array elements. As will be described below with respect to FIGS. 7 and 8, the "sequence number high" value is used when an object pointer is stored in this element. See the discussion of the sequence number high field 340 of an object ID, below.
Whenever a new object pointer is stored in the object array 280, the element at the top of the free list (pointed to by the link head 298) is popped off the top of the free list and is used to store the new object pointer. The count field 296 is also incremented. When an object pointer is deleted, it is added to the top of the free list and the count field 296 is decremented.
The header of every object, including a object container object 270, contains a back pointer to the container in which it resides. The container which holds an object container is a container directory 260, and therefore the object container's back pointer 299 points to its container directory 260. The back pointer in the object header of a container directory object (not shown) points to itself.
A container directory 260 comprises a container directory object 300, which has the same basic data structure as an object container 262. However, the object names in the name table 306 of a container directory 260 are the names of object containers. In other words, the objects referenced by the name table 306 and the object array 310 in a container directory are object containers, whereas many different types of objects can be referenced by the name table 275 and object array 280 of an object container 262. Note that every object, including container directories, must have at least one object ID and one corresponding pointer in a container. Since there is no "container for container directories", the first entry in the object array 310 of an object container is a pointer to itself.
The container directory object 300 contains an additional pointer called the display index 312. For system and job level container directories, the display index simply points at the first item in the object array 310.
For process level containers, the top entries in the object array point to the publicly accessible object containers visible to the process, herein called display containers, and the next entry points to the private container for the process. As mentioned above with reference to FIG. 3, each process is assigned at least two process level object containers 212 and 214. The first object container 212 is called the public display container for the process and the second container 214 is called the private container. Only objects that the process wants to be accessible to subprocesses are placed in the public display container 212, and all other objects created by the process are put in its private container 214 or other private object containers.
Referring to FIG. 6A, there is shown a more detailed diagram of the process level container directory 260 for a process. Whenever a subprocess is created, it is automatically given a pointer 314 to its parent's public display container as well as a pointer 316 to its own public display container and a pointer 318 to its private display container. As shown in FIG. 6A, the display index 312 points to the entry 316 in the object array which points to the public display container for this process. If this process is a subprocess, above the public display entry 316 are pointers 314 and 320 which point to the display containers for this process's parent process and grandparent process, and so on. Below the entry 318 for the process's private container, the container directory 260 may contain pointers 322 to other process level private containers for this process.
OBJECT DATA STRUCTURE
Referring to FIG. 7, when an object is created, it is assigned a 64-bit value called its object ID 330. This value provides the fastest means for a user-mode routine to identify and access the object. Only kernel mode routines can use pointers which directly address an object.
When an object is created, the "object ID" returned by the object creating routine is called the principal ID. Every object has only one principal ID. An object may also have one or more reference IDs which also point indirectly to the object. Reference IDs are discussed below in the section entitled Reference IDs.
Both the principal ID and reference IDs are herein called "object IDs". In addition, it should be noted that these IDs are not "capabilities" as that term is used when describing capability based operating systems--rather they are indirect pointers to data structures called objects.
The principal ID of an object that is accessible by two processes is the same in both processes. This extends to objects at all levels. This property allows IDs of shared objects to be communicated between cooperating threads.
Object IDs are used to uniquely identify objects within the system. It should be noted that an object ID is not the address of an object; it is a value which may be translated into the address of an object through the use of the object array in an object container as shown in FIG. 6. Thus object IDs only indirectly point to objects.
Referring to FIGS. 6 and 7, the fields of an object ID 330 are as follows. An index into a container directly 332 is used to index into the object array 310 of a container directory 260 and thereby find a pointer to the object container 262. An index into a container's object array 334 is used to index into the object array 280 of an object container and thereby find a pointer to the object.
The level 336 of the principal object ID determines the level of an object's visibility: process, job or system, as was discussed with reference to FIG. 3. To find the container directory for an object ID, one may refer to the software process control block 252 (see FIG. 5). Any process which can express the object ID for an object can try to access the object. As shown in FIG. 5, the software control block 252 contains a pointer to the container directory corresponding to each level of visibility.
The sequence number low 338 and sequence number high 340 are used to prevent a program from using an object ID after the corresponding object has been deleted, and other types of programming errors. The sequence number low field 338 is a ten bit value which receives a new randomly generated value each time that a new object is created. The sequence number high field 340 is a ten bit value inside each object ID that is incremented each time that an object is created, and reset to zero when it overflows.
Note that the elements 290-294 in the object container are reused after an object is deleted. When an object pointer is deleted from the object array 280 in a container, the sequence number high 340 for the corresponding object ID is stored in the element that formerly held the deleted object pointer. The value of the sequence number high is incremented and stored in an object ID (and in the header of an object, as will be explained below) the next time that this element of the object array is used to store a pointer to a newly created object.
The use of sequence numbers does not totally eliminate the problem of illegal references to deleted objects, it just reduces it to an extremely small probability for most programming situations.
Referring to FIG. 8, each object 350 in the preferred embodiment has two parts, a standard object header 355 which is only manipulated by kernel mode object architecture routines, and an object type specific body 360 which is manipulated by object specific service routines.
The object header 350 of each object is a data structure that has a number of fields 362-396. The object type 362 identifies the type of the object. The PTR-Object Type Descriptor field 368 contains a pointer to an object type descriptor (OTD) for this particular object type. OTDs will be discussed below with reference to FIG. 9.
In a typical implementation of the present invention there will be at least twenty-five different types of objects, including container directories, object containers, user definition objects, job definition objects, process control blocks, thread control blocks, and many others. For each object type there is an object type descriptor 400, described below with reference to FIG. 9, which specifies the routines for handling, allocating and deleting objects of that type. When an object ID is translated into a pointer to an object header, the type field 362 in the object header is compared with the desired object type to make sure that the proper object is being accessed.
For all objects except container objects, the object ID count 366 represents the number of object IDs which refer to the object. For container objects, the object ID count 366 represents the number of container directory object array pointers which refer to the object, which is also the number of container directories that can refer to this object container. Note that for container objects the object ID itself is not counted. Hence, for object containers, the object ID count 366 is equal to one unless the container is a display container for a parent process (see FIG. 6A and the corresponding discussion, above).
The object ID count 366 signifies the number of reasons that an object should not be removed from the system. If the object ID count 366 is zero, then no object container has a pointer to that object's header 355.
The object ID count field 336 is never directly incremented or decremented by a user mode routine, only the executive routines for object support operate on this field 366. For a kernel mode routine to increment or decrement this field 366, the mutex field 278 (in FIG. 6) of the object container in which this object resides and directory-level mutex must first be acquired. This is necessary to ensure that an object cannot be deleted while another reference to the object is being established. As will be explained below, it is sometimes necessary to acquire several mutexes before performing an operation on an object to ensure the integrity the object.
Whenever an access to an object will span a period of time that can not be protected by use of mutex locks on appropriate data structures, the pointer count field 364 must be incremented. In particular, an address of an object may not be used to regain access to the object unless the pointer count 364 has been previously incremented.
The pointer count 364 represents the number of pointers that have been taken out on the object, plus one for a non-zero object ID count. When an object ID is translated by an object service routine, the pointer count 364 is incremented by one. The pointer count 364 for an object signifies the number of reasons the storage for an object should not be deallocated. To increment this field, the directory-level mutex must first be held. This is necessary to avoid race conditions with the object ID being deleted.
When an object ID, object container pointer, or reference object ID is deleted, the object ID count 366 of the object is decremented. If the resultant object ID count is zero, the pointer count 364 is decremented, and then the process of deleting the object is begun by calling an object type-specific remove routine to initiate any required object type-specific removal actions, such as canceling I/O.
As mentioned above, when the object ID count 366 is decremented to zero, this causes the pointer count 364 to be decremented, as does the dereferencing of a pointer. When the pointer count 364 reaches zero, the object type-specific delete routine is called, and the object's storage is deallocated (i.e., the object is deleted).
One of the major goals of the lock strategy for objects is to allow the pointer count 364 to be decremented without having to hold a lock (i.e., mutex) to do so. This allows low overhead dereferencing of objects on such operations as I/O, wait, and the deleting of a reference object. Note that the pointer count 364 should be non-zero whenever the object ID count 366 is non-zero.
The link field 370 contains a forward pointer to the next object header of this type, as well as a backward link to the previous object header of this type. Thus all objects of each type are linked into a doubly linked list. The list head resides in the OTD for the object type, as will be shown in FIG. 9.
The container pointer 372 is a pointer to the object container in which the object resides. This field, also called the object's back pointer, is dynamic in that the object may be transferred to a different object container. Such a transfer would result in the assignment of a new object ID of the object. This field is zeroed when the principal object ID is deleted. This field 372 may be accessed only by a thread holding both the directory-level mutex and the mutex 278 (shown in FIG. 6) within the object container.
The index into container field 374 is the index into the object array in the container for this object.
The level field 376 specifies the level of visibility of the object, and the level of the object container in which the object resides.
When an object ID is translated into the address of an object, the value of the object ID's sequence fields 338 and 340 (see FIG. 7) are compared to the values of the sequence fields 378 and 380 in the object header. If they are not identical, then the object ID in invalid (i.e., the object referenced by the object ID has been deleted and the corresponding object ID entry in the object container has been reused).
The sequence number fields 378 and 380 of an object may be accessed only by a process which holds both the directory-level mutex and the mutex within the object container.
Note that it is possible to construct the principal object ID for an object if one is given the object header. The level field 376 is equal to the level field 336 in the object's principal ID, and the sequence number fields 378-380 are equal to those in all of the object's ID. The container index field 374 of the object header is equal to the container index field 334 of the object's principal ID.
Finally, the container directory index field 332 of the object ID is constructed as follows. The container pointer field 372 points to the object header of a container. The index field 374 in that container's object header is equal to the directory index 332 for the principal object ID.
A dispatcher pointer 381 in the object header is given a nil value if the object is not a waitable object, as will be explained in more detail in the section entitled Waitable Objects. If the object is a waitable object, the dispatcher pointer 381 points to a data structure for a "kernel synchronization primitive" that is stored in the object body 360.
The pointer 382 to a name definition block is used to associate a name string with an object. If the object has an associated name, this field 382 contains a pointer to a name definition block which contains the name. Otherwise this field has a value of zero. The directory level mutex, the object container mutex, and the type-specific mutex must all be acquired in order to modify this field 382.
The owner's field 384 identifies the owner of the object. This field is used by the security access validation rules, which are discussed below in the section entitled Access Control Lists.
The ACL pointer field 386 points to an access control list (ACL) for the object. A nil value indicates that no ACL exists for the object. The format and use of the ACL are discussed below in the section entitled Access Control Lists.
The allocation block pointer 388 is a used by object ID translation routines to ensure that the thread which is trying to access the object has access to the object. In order to translate an object ID into a pointer to an object header, the requesting thread must have access to the object as determined by the ACL, and must be in the allocation class of the object. Object allocation and allocation classes are discussed below in the section entitled Object Allocation.
The Allocation List Head Offset parameter 389 is non-negative when the object 350 has other objects allocated to it. The Allocation List Head Offset 389 indicates the position in the object body 360 of a list head which points to a list of allocation blocks for the objects allocated to this object.
Several binary flags 390-396 govern use of the object. When the temporary flag 390 is set it indicates that the object is temporary. If an object is temporary, the object is automatically deleted when all reference IDs to it are deleted. Note this is different from ordinary object deletion, which occurs when both the object ID count 366 and the pointer count 364 are equal to zero. Therefore, when the object ID count is decremented to one, the temporary flag field 390 must be checked. This will be explained in more detail in the section entitled Reference Object IDs and Temporary Objects.
The transfer flag 392, when clear, indicates that the object cannot be transferred to another container. The transfer action field state is determined at the time the object is created.
The reference inhibit flag 394, when true, prevents the creation of reference IDs to this object.
The access mode flag 396 contains the owner mode (kernel or user) of the object. Kernel-mode objects may not be created in user owned containers. Mode is also used to verify access to the object by the access validation procedures described below in the section entitled Access Control Lists.
OBJECT TYPE DESCRIPTOR (OTD)
Referring to FIG. 9, there is a single object type descriptor (OTD) for each object type defined by the system. OTDs are objects, and all OTD objects reside in a single system level container.
OTD objects have a standard object header 402 and an object body which contains general information about an object type, not a particular instance of an object. For example, an OTD indicates whether an object type supports synchronization or wait operations. Anything an OTD specifies about an object type applies to all instances of that object type.
Part of the information in an OTD 400 is the location of a number of routines 430-438 that may be called by the executive 144 (see FIG. 2). These routines have standard definitions across all object types, but require object type-specific processing. The routines are located by the executive via standard offsets into the OTD, at which are located pointers 420-428 to these routines.
Users of object instances of a particular type do not need to know anything about the routines 430-438 pointed to by the OTD. Only the designer of an object type must know how these routines work. Thus, the present invention makes it relatively easy to introduce new object types into a system because standard types of operations which depend on the particular structure of a new object type, such as creating, allocating and deleting the object, are defined by the designer of the object type and thus the details of the object's structure do not concern the users of these objects.
All the fields 404-428 of the OTD's body have a standardized definition. This allows the executive 144 to use the information in an OTD without having any detailed knowledge of the corresponding object type.
The Object Type field 404 contains a value indicating the type of object the OTD represents.
The List Head field 406 is a list head for a doubly linked list 405 of all the object instances of this type. The List Head field 406 contains a forward link to the first object header of this type, and a backward link to the last object header of this type. These links are used for consistency checking within the object architecture.
The Count field 408 contains a count of the number of objects of the corresponding type that currently exist in the system.
The Dispatcher Offset 410 is used only for object types which support wait operations. When non-negative, the Dispatcher Offset 410 is the offset from the start of the object body to a "kernel synchronization primitive" which is located inside the object body for object instances of this type. The Dispatcher Offset 410 is used to compute a pointer to the kernel synchronization primitive, called the Dispatcher Pointer, that is stored in each object's header. When a wait operation is to be performed on an object instance of this type, the system's executive 144 issues a kernel wait operation on the kernel synchronization primivite pointed to by the object's Dispatcher Pointer. Kernel synchronization objects are discussed in more detail below in the section entitled Waitable Objects.
Any object type which has a non-negative dispatcher field must allocate the object instances of this type from non-paged portions of the system's primary memory because the kernel synchronization object must be in non-paged memory.
The Access Mask 412 is a bit mask which is used in conjunction with access control lists, and is discussed in section below entitled Access Control Lists.
The Allocation List Head Offset 414 is used only for object types that may have objects allocated to it. For example, thread objects, process objects, job objects and user objects can have other objects allocated to them. When the Allocation List Head Offset 414 is non-negative, it is the offset from the start of the object body to a list head which points to a set of allocation blocks. Object allocation and allocation blocks are discussed in more detail in the section entitled Object Allocation.
The Create Disable Flag 416, when set, prevents additional objects of this type from being created. It is used as part of process of shutting the system down in an orderly fashion.
The OTD Mutex 418 provides synchronization for creation, deletion and state changes among objects of this type.
The Allocate field 420 points to an allocation procedure 430 which performs object type-specific procedures when an object of this type is allocated to a user or process. Object allocation is discussed below in the section entitled Object Allocation. A null routine is provided for use by object types which do not have an allocate procedure.
The Deallocate field 422 points to a deallocation procedure 432 which performs object type-specific procedures when an object of this type is deallocated from a user or process.
The Remove field 424 points to a remove procedure 434. The remove procedure 434 for each object type performs any necessary actions that must be performed before deleting an object. The remove procedure is called when all object IDs to the object have been deleted. This procedure 434 allows object type-specific processing to be performed after applications can no longer reference the object instance, but before the object instance is actually deleted. A null procedure is provided for use by object types which do not have a remove procedure.
The Delete field 426 points to a delete procedure 436, which is responsible for manipulating object type-dependent data structures and deallocating the storage allocated for the object's extensions. The delete procedure is called when an object's pointer count 364 is decremented to zero. Note that the pointer counter 364 cannot decrement to zero when the object ID count is non-zero. After the delete procedure 436 is run, an object deletion routine in the kernel deallocates the storage for the object's header and body. A null procedure is provided for use by object types which do not have a delete procedure.
The Shutdown field 428 points to a shutdown procedure 438. The shutdown procedure 438 is called once when an object type is permanently removed from the system, generally at system shutdown time. The purpose of this routine is to perform object type-specific shutdown operations. Among other things, this provides the opportunity to dump any statistics that may have been gathered relating to the object type.
Although not referenced in the OTD 400, there is a distinct object creation routine 440 for each object type, herein called CREATE.sub.-- XXXX where XXXX identifies the object type. The create routine 440 creates new instances of the object type, allocates space for the object body and its extensions, and also stores initial values and data structures in the object body.
Table 1 is a list of some of the object types used in the preferred embodiment and which are discussed in this specification.
CREATING NEW OBJECT TYPES
Except for a few object types used by the object architecture itself, such as object containers, all object types are defined within the system by calling a service routine to create an object type-specific Object Type Descriptor (OTD), the format of which is shown in FIG. 9. This service routine is called Create.sub.-- OTD. The OTD for each object type contains information that allows the system to interact with object type-specific routines in a standard fashion.
It is a feature of the present invention that there is a simple procedure for defining new types of objects and a corresponding set of object type-specific routines for interacting with the system. Referring to FIG. 10, all OTDs are objects stored in a system level container 460 called the OTD Container. When a new OTD 462 is created, it is added to the list of defined OTDs--i.e., it is added to the OTDs in the OTD Container 460 and is linked to the list of OTDs by the Link field 370 (shown in FIG. 8) in the headers of the OTDs. This provides the framework for operating system-to-object type interactions. It also provides a standardized location for keeping object type-specific control information. For example, a count field 408 (shown in FIG. 9) in each OTD contains a count of the instances of the related object type.
To create a new OTD 462, the caller must provide the following items. A name 464 must be provided for the new object type, which is stored in the name array of the OTD container 460. The caller must also provide a set of routines 466 for allocating, deallocating, removing, and deleting objects of this object type, and for handling objects of this type during system shutdown. A non-negative allocation list head offset 468 is provided if the new object type is to be an object type to which other objects can be allocated. A non-negative dispatcher offset 470 is provided if the new object type is to be a waitable object.
An access control list 472 may optionally be provided if use of the new object type is to be restricted to a defined set of authorized users. Additionally, an access mask 474 must be provided to indicate the types of allowed access to objects of this type.
A special routine 476 must be provided for creating objects of the new object type. This routine is generally named Create.sub.-- XXXX where "XXXX" is the name of the object type. The create object routine 476 uses information in the OTD 462 to allocate the space needed for new object instances and to create new object instances 478 of this type. The create object routine 476 and the other system interface routines 466 are the primary routines which must have detailed knowledge of the internal data structure of object instances of this object type.
REFERENCE OBJECT IDS AND TEMPORARY OBJECTS
When an object has an outstanding pointer to it, its data structures cannot be deleted. There are two methods of preventing an object from being deleted: one for kernel mode routines and one for user mode routines. The executive 144 (which operates in kernel mode) can increment the pointer count field 364 when a routine is repeatedly accessing an object to prevent the object from being deleted. A user-mode program can prevent an object from being deleted by creating a reference ID to the object ID.
Referring to FIG. 11, there is shown an object 500 and a job level container 502 in which a pointer 504 to the object is stored. The object 500 has a principal object ID 506 which indirectly references the object 500 by way of the object pointer 504. Creating a reference ID 508 creates another object ID for the object 500 which indirectly points to the object 500 via a pointer 510 in another container 512.
When a reference ID is created for an object, the object ID count 366 (see FIG. 8) in the object's header is incremented but the pointer count 364 is not. This ensures that object ID count will not be decremented to zero, and that the object's storage cannot be deleted until the reference object ID is deleted.
The visibility of an object when it is created is the visibility of the object container in which it is inserted. The visibility of an object identified by a reference ID is the visibility of the object container specified when the reference ID is created.
The level of the target container 512 specified when creating a new reference ID 508 must be less visible than the container in which the object resides (i.e., the container corresponding to the principal object ID 506). Additional reference IDs 520 can be created using other target containers 522. In general, a process 518 will usually generate only one reference ID for an object. Therefore each reference ID for an object is usually created using a different container, and in a container different from the container holding the object.
One reason for the constraint that reference IDs must be created using a less visible container than the source container is that creating a reference ID cannot be used as a method of increasing the visibility of an object. The only way to increase the visibility of an object is to move the object to a more visible container. In general, only the owner of an object has the authority to move the object to a more visible container.
Another reason for the constraint that reference IDs must be created using a different container than the source container is the system must be able to differentiate between reference and principal IDs. Both the reference IDs and the principal ID for the same object translate into a pointer to the same object header.
Creating Reference IDs. Referring to FIG. 12, there is shown a flow chart of the process for creating reference IDs. The process starts when a thread calls the routine and provides as inputs an object ID for an object and a target container ID that determines the visibility of the object identified by the new object ID (box 550).
The new reference ID creation routine then acquires the mutexes for the target container directory, the target container, and the source container directory (box 552). Note that the "source container" is the container that holds the object for which a reference ID is being created.
Next, the source (input) object ID is translated into a pointer to the object (box 554). At this point the routine aborts if the level of the target container is not less visible than the level of the source container, or if the source object is an object container or container directory.
Then an element in the object array of the target container is allocated for storing a pointer to the source object (box 556).
The source object's type specific mutex, referenced by the corresponding OTD, is acquired (box 558) for incrementing the object ID count in the source object's header (box 560). Then a pointer to the source object is stored in the target container at the allocated index position (box 562).
A reference ID (in the format shown in FIG. 7) is constructed using the target container directory, the allocated target container index, and the sequence number of the source object (box 564). At this point all the acquired mutexes are released (box 566) and the new reference ID is returned 568 to the thread (i.e., user program) which called the create reference ID service routine.
Temporary Objects. Marking an object as temporary is used to cause an object to be deleted when all of its reference IDs are deleted. This is particularly useful when several processes or threads share the use of an object because no one process or thread is required to be responsible for deleting the object (i.e., its principal ID) when all the processes are done using the object. Thus when an object is marked as temporary it is given a temporary lifetime which expires when all users of the object are done with it, as signified by the deletion of all reference IDs for the object.
Note that ordinary objects are deleted only when both the object ID count 366 and the pointer count 364 for the object are equal to zero. Thus the principal ID of a non-temporary object must be explicitly deleted before the object will be deleted.
When marking an object as temporary, if the object has no reference IDs, then the object's principal ID and the object itself are deleted immediately. The only objects that can be marked as temporary reside at the job or system levels because only objects at the job and system levels can have reference IDs.
An object is marked as temporary by acquiring the mutexes for the object's container directory and container, and the object type-specific mutex, and then setting the temporary flag 390 (see FIG. 8) in the object's header. A thread can mark an object as temporary only if it has Delete Access to the object (see below discussion entitled Access Control Lists).
An object can also be made temporary by moving it to an object container at a more visible level and marking the moved object as temporary. See the discussion below entitled Moving An Object To A New Container. A new principal object ID is created for the object to denote its new level, container directory and container. The original principal object ID becomes a reference object ID, thereby ensuring that the temporary object has at least one reference ID.
Deleting Object IDs. Referring to FIG. 13, there is shown a flow chart of the routine for deleting reference IDs and object IDs and for automatically deleting objects when there are no remaining pointers to those objects. This routine also handles the deletion of temporary objects--which are objects in which the temporary flag 390 (see FIG. 8) in the object header is set.
The only input to the object ID deletion routine is the object ID to be deleted (box 580). The routine acquires the mutex for the container directory at the level specified in the object ID (box 582), and translates the object ID into a pointer to the object (box 584). If the object ID's sequence number does not match the sequence number of the object, the object ID is invalid and the routine exits.
Next, the object's container mutex and the object type-specific mutex are acquired (box 586) so that the object ID can be deleted and the object ID count of the object can be decremented (box 588). If the resulting object ID count is equal to one (box 590), the routine checks to see if this is a temporary object (box 592). If not, the routine exits. If the object is a temporary object, one further test must be performed before the object can be deleted.
Note that the principal object ID of an object can be deleted while one or more reference IDs are outstanding. A temporary object is only deleted when all of its reference IDs have been deleted. When the principal object ID of an object is deleted, the container pointer 372 in the object's header, which is also called the back pointer is reset to nil. Therefore the way to test to see if the principal object ID has been deleted to is see if the back pointer in the object header is set to nil. If so, the object will be deleted only when the object ID count is decremented to zero.
Therefore, after determining that the object ID count is equal to one and the object is a temporary object (boxes 590 and 592), the object ID deletion routine checks to see if the object's back pointer is not equal to nil (box 594). If the back pointer is equal to nil, the principal object ID was deleted and there is a reference ID still outstanding. Therefore the object cannot be deleted and the routine exits.
If the object's back pointer is not equal to nil, there are no remaining reference IDs. Therefore the principal object ID for the object is deleted (box 596) and then object is deleted (box 598). Object deletion is done in two stages. First the remove routine for the object type is called to perform any object type-specific actions required to prepare the object for deletion. Then, when the object's pointer count reaches a value of zero, the delete routine for the object type is called to deallocate the object's storage.
If the object's pointer count is not equal to zero, the object will be deleted as soon as the object is dereferenced by the routines which hold pointers to it, which will cause the pointer count to be decremented.
If the object ID count was not equal to one (box 590), the routine checks to see if the object ID count is equal to zero (box 599). If so, object deletion proceeds as discussed above (box 598). If the object ID count is not equal to zero, the routine exits, having deleted the object ID and decremented the object's ID count.
It should be noted that the remove routine for the object is called when the object ID count reaches 0, and that the delete routine is called when both the pointer count and the object ID count reach zero. Also the remove routine is called before the delete routine. See the above discussion of the remove and delete routines in the section entitled Object Type Descriptor.
MOVING AN OBJECT TO A NEW CONTAINER
In computer applications it is often desirable to share or hand-off access to the abstractions represented by objects. In the context of the present invention, sharing access to an object generally requires moving an object from its current object container to another object container. For example, an object can be transferred from a job level object container to a system level object container. This would make the object accessible throughout the system instead of just within a job. A object may also be transferred from a process level container to a job level container, or from a process private container to a process display container.
As described above with references to FIG. 8, the object header of each object instance has a transfer flag 392. The transfer flag 392, when clear, indicates that the object cannot be transferred to another container. In addition, objects with a non-zero number of reference IDs cannot be transferred to a new container.
When an object is transferred to a new container a new object ID is created for the object using a new container, the object's name is transferred to the new container, and the current object ID is deleted.
Referring to FIG. 14, there is shown a flow chart of the routine for moving an object to a specified container. The input parameters (box 620) to the routine are the object ID of the object to be transferred, the object ID of the target container to which the object is to be transferred, and a "delete upon collision flag", the purpose of which will be explained below.
The routine begins by acquiring the mutex for the current container directory level of the object (box 622) and translating the specified object ID into a pointer to the object (box 624). Then the object's transfer flag is tested and the ID count is checked to make sure it is equal to 1 (box 626). If the transfer flag is clear, or the ID count is not equal to 1, the specified object cannot be transferred and the routine aborts. Otherwise, the routine continues by obtaining the mutexes for the target container directory level and the target container (box 628).
Next, the routine checks for a collision (box 630). A collision situation exists when an object of the same type and name as the specified object exists in the target container. If the "delete upon collision flag" is clear and a collision occurs (box 632), the routine aborts. When the "delete upon collision flag" is set, the original object is deleted and the routine returns the object ID of the duplicate object in the target container (box 634).
If a collision does not occur (box 630), an object index is allocated in the target container, a new principal object ID is created for the object, the object's name and a pointer to the object are stored in the target container, the source (input) object ID is deleted, the mutexes are released, and the routine returns the new object ID to the caller (box 636).
As noted above, an object can be made temporary when it is moved to a more visible container. The reason for making such objects temporary is that in many situations no one process can take responsibility for deleting an object. By providing temporary objects, the present invention provides a mechanism for automatically deleting such objects when no process retains a reference ID to the object. The routine for moving an object to a more visible container and making an object temporary is basically the same as the move object routine shown in FIG. 14, except that (1) the object is marked as temporary, and (2) instead of deleting the original object ID, the routine replaces it with a reference ID so that the temporary object will not be deleted immediately.
TRANSFERRING AN OBJECT CONTAINER
In systems using the present invention, a large portion of a program's context is contained in object instances. By being able to transfer object instances from a creating program to a created program, a new program's context can be passed to a newly created process. The object containers always present for a process are a job level object container, a process level private container, and a process level display container (i.e., a container which is automatically accessible to subprocesses created by this process).
When creating a new job, it is possible to transfer entire object containers of object instances to be used for any or all of the object containers used by the job. When creating a process, it is possible to transfer an entire object container of object instances to be used as the initial process private object container, or the process display container, or both. In either case, when object containers are transferred in this fashion, they become inaccessible to the creator of the new job or process because the new container is generally not in the visibility range of the creator process.
When transferring an object container of object instances in this fashion, the object containers provided by the creating program are called the source object containers. The object instances contained in the source object containers are called source object instances.
Referring to FIG. 15, there is shown a flow chart of the routine for transferring an object container to a specified container directory. The input parameters (box 660) to the routine are the object ID of the source object container to be transferred, and the object ID of the target container directory to which the source object container is to be transferred.
The routine begins by acquiring the mutex for the source container directory level of the source object container (box 662) and obtaining a pointer to the source object container (box 664). Then the object container's transfer flag is tested (box 666). If the transfer flag is clear, the container is not transferable and the routine aborts. Otherwise, the routine continues by checking all the object IDs in the container (boxes 666, 668 and 670). In order for the container to be transferable, all the objects in the container must be transferable, and all must have an ID count equal to 1 (i.e., there must be no reference IDs for any of the objects in the source container) (box 668). If any of the objects in the container do not meet this criteria, the routine aborts.
Next, all the reference IDs in the source object container, if any, are checked to make sure that all the objects referenced are system level objects (i.e., have a level value 376 in the object header which designates the system level) (box 670). If not, the routine aborts.
If all the above tests were passed, the routine continues by acquiring the mutex for the target container directory (box 672). Then it adds a pointer to the source object container in the target container directory, updates the source container's header (i.e., the container pointer field 372) to point to the target container directory, removes the pointer to the source container from the source container directory, and finally releases all the acquired mutexes (box 674). As a result the specified object container has been transferred to the specified target container directory, typically for a newly created job or a newly created process.
CREATE IF OBJECT NOT ALREADY PRESENT
Within a computer application, it is sometimes necessary for several programs to work in conjunction with one another. In this environment, it is not unusual for the programs to share access to the abstractions represented by objects. In some cases it is difficult to determine, or at least not relevant to the problem being solved, which program will be ready to access the shared objects first.
The present invention provides a condition object creation routine which creates an object if it is not already present, herein called the Create If semantic. This allows a set of application programs to all be designed as if they were to all create each shared object. When an application attempts to create a shared object, the conditional object creation routine checks to see if the object already exists. If so, then the attempt to create the object simply returns the object ID of the already existing object.
Referring to FIG. 16, the conditional object creation routine requires inputs of the object type of the object to be created, the object ID of the target container in which the object is to reside, and a name that is to be assigned to the object (box 720). The routine begins by acquiring the mutex for the target container directory level (box 722). Then it checks the list of objects in the target container to see if that container already contains an object with the specified name and type (box 724). If such an object does not already exist, the routine acquires the required mutexes for creating a new object (box 728). Then it creates the specified object in the target container, releases the acquire mutexes, and returns the object ID of the new object to the caller (box 730).
Otherwise, if the specified object already exists, the routine returns the object ID of the object which already exists in the target container (box 732).
ACCESS CONTROL LISTS
Any resource in the computer system can be protected so that only certain users can access it, or the resource can be left unprotected so that all users can access it. The present invention controls access to resources by checking the user's access rights against the resource's access control information to verify that the user has access to the resource.
Any resource that needs to be protected must be an object or must have an object associated with it. The access to a resource is checked indirectly by the executive's routine which translates an object ID into a pointer to an object. Whenever a program references an object by its object ID, the access rights of the user are compared with the access control information in the object.
Each user of the system is given a set of access rights in the form of an "ID list". Access rights represent the user's claims to resources on the system. Access rights are kept in each thread owned by a user. Referring to FIG. 17, the thread control block 800 (which is part of the object body of a thread object) of a thread contains a mode value 802, and a pointer 804 to an ID list 806.
The mode 802 is the processor mode in which the thread is executing. The mode is either User or Kernel. The ID list 806 contains a list of 32-bit values called identifiers 808, 810, 812, the first of which is called the "user identifier" because it is unique to each user of the system. The identifiers represent who the user is and what groups he is a member of. The user is assigned the same identifiers each time that he gains access to the system. Each identifier also has an alphanumeric name at the human interface level.
In some circumstances, a thread can have two distinct ID lists 806 and 815, where the first list 815 is the list originally given to the thread, and the second list 806 is a list adopted temporarily for executing a set of tasks for another process.
The preferred embodiment of the present invention does not provide "privileges" in the access rights of a user. Instead, privileged access to objects is implemented using identifier lists and access control objects.
Each object 822 has access control information that describes the access rights needed by a user to gain access to a resource. The object header 820 contains the access control information.
The access control information of an object is made up of three parts: a mode, an owner identifier, and an access control list (ACL). The mode is the processor mode (User or Kernel) in which the object was created. The owner identifier is the user identifier of the object which created the object. The ACL is a list of one or more access control entries. Referring to FIG. 17, the header 820 of an object 822 contains a pointer to the access control list 824 for the object 822, if any.
The ACL 824 contains an ACE count 826, which is equal to the number of access control entries (ACEs) 828, 830, 832 in the ACL. There are two types of access control entries: access entries and audit entries. Each access entry 828 contains an ACE type value 840 which indicates this is an access entry, an ACE Mask 842 which indicates the type of access governed by this ACE, a Stop Flag 844 explained below, and an ID count 846 which specifies the number of identifiers there are in the entry's ID list 848. In order to gain access to the object, the thread's identifier list 806 must contain identifiers matching all the identifiers in the ACE's ID list 848, and the type of access requested must be a subset of the access types specified by the ACE Mask 842.
Referring to Table 2, the Access Mask 842 is a set of 32 bit flags which indicate various types of access. For instance, if bit 01 is set in the Access Mask 842, then the ACE 828 governs READ access to the object. If bit 02 is set in the ACE Mask 842, the ACE 828 governs WRITE access to the object. The first sixteen bits of the ACE Mask 842 concern standard types of access which apply to all types of objects.
The second sixteen bits of the ACE Mask 842 are object type-specific. For instance, OTD objects use ACE Flag 17 as the bit for "Create Access"--i.e., the right to create objects of the type specified by the OTD object. Table 2 also shows an example of object type-specific access types of a queue object.
Referring to FIG. 9, the access mask 412 in each OTD is a bit mask which is used in conjunction with access control lists. In particular, the access mask 412 determines which types of access are defined for objects of the type corresponding to the OTD. The only types of access allowed to objects of that type are access types for which the corresponding bits are set in the access mask 412. The definitions for the bits in the access mask 412 have a one to one correspondence to the definitions for the bits in the ACE Mask 842 of each ACE 828.
Referring to FIG. 17, the purpose of audit ACE's such as ACE 832 is to monitor access to an object. Each audit ACE 832 contains an ACE type 850 which specifies that this is an audit ACE.
The Audit Flag field 852 contains three flags that, when set, modify the characteristics of the audit to be performed. These flags are specific to one audit ACE. The Audit Flags include a Success Flag, a Failure Flag, and an Alarm Flag. When the Success Flag is set, the audit ACE is checked whenever access is granted by the system's access checking routine. The Failure Flag, when set, specifies that the Audit ACE should be checked whenever access is denied by the system's access checking routine. The Alarm Flag is examined if a message is generated from the Audit ACE. This flag, when set, specifies that the type of message generated from the Audit ACE is an alarm message. If the Alarm Flag is clear, an audit message is generated. An audit message signifies that occurrence of a normal event. The message can be written to a log file and examined later. An alarm message signifies the occurrence of an abnormal event. Alarm messages are typically logged to a security console so that immediate action can be taken by the security manager.
The monitor flags 854, which correspond to the ACE Flags and the bits in the access mask 412 for the OTD, indicates the types of access to be monitored by the Audit ACE 832. The Audit Name 856 is the name of the message unit (or channel) into which the messages generated by the audit ACE are written.
Appendix 1 contains a pseudocode representation of the process for checking the ACL of a specified object and determining whether a user is to be granted access to the specified object. The pseudocode program in Appendix 1 at the end of this specification is written using universal computer programming conventions and are designed to be understandable to any computer programmer skilled in the art. Comments and unexecutable statements begin with a double asterisk "**".
According to the steps of the ACL checking process as shown in Appendix 1, access is denied if the access desired by the caller of the check access routine is not supported by the object. If the access type desired is supported by the object, and the caller's access mode is KERNEL, then access is automatically granted. In other words, access checking beyond checking for supported types of access is performed only for USER mode callers.
If the object does not have an ACL and the mode of the object is USER, access is granted. Otherwise the mode of the object is KERNEL and access is denied.
If the object does have an ACL the following steps are performed for each access ACE in the ACL. If the user's ID list holds the identifiers listed in the ACE's ID List 848, then if the access desired is allowed by the access ACE, access is granted. However, if the user's ID list holds the identifiers listed in the ACE ID List but the type of access desired is not allowed by this access ACE then the Stop Flag 844 of the ACE is inspected. If the Stop Flag 844 is set, this means that no more ACEs should be examined, and access is denied. If the Step Flag 844 is not set, the access checking process continues to examine any additional ACEs there may be in the ACL.
This process continues until either all the access ACEs have been checked, or the caller is positively denied access.
The purpose of the Step Flag 844 is to explicitly prevent specified users from accessing an object, or to explicitly limit their access to certain specified access types. To prevent or limit access to an object by a specified user (or set of users), the ACL for the object is given an ACE 828 with a set Stop Flag 844, an ID list 848 that specifies this user (or set of users), and an ACE Mask 842 that lists the access types (if any) allowed to the specified user. When the specified user tries to access the object 822, the access checking routine will not inspect any ACE's after the ACE with the set Stop Flag.
One last type of access is allowed: if the caller holds the object's owner ID, then the caller is allowed "SET.sub.-- ACL" access to the object--which allows the caller to modify the object's ACL.
PRIVILEGED OPERATION OBJECTS
As stated above, the object based architecture of the preferred embodiment does not have "privileges". In the present invention, the number of allowable privileged operations is not limited, unlike most prior art system which allocate privileges to the users of the system. Identifiers and Access Control Entries (ACEs) in access control lists are used instead of privileges. For example, a user may create a new container and then specify that it be inserted into the system-level container directory. Because the container directory is at the system level, this is a restricted operation.
To control usage of a restricted operation, such as adding object containers to the system container directly, an ACL is added to the system level container directory. An identifier, called SYSTEM.sub.-- LEVEL, is created and given to the group of users who are to be allowed insert object containers into the system level container directory. More specifically, the ACL for the system level container directory contains a separate ACE for controlling WRITE access to the container directory. The identifier list for this ACE contains just one identifier: the SYSTEM.sub.-- LEVEL identifier. Thus any user that is granted this identifier can insert a new container into the system-level container directory.
As can be seen by the previous example, access to most privileged operations is controlled simply by using the ACL mechanism to determine which users have access to a corresponding object. Some privileged operations, however, do not inherently reference an object. For example, setting the system time is a privileged operation, but does not involve an object. To protect this privileged operation from unauthorized use, a special object is created and the privileged operation is defined to reference the special object. More specifically, the code for the privileged operation is modified so that it will perform the privileged operation only if the user has a predefined type of access (i.e., PERFORM OPERATION access) to the special object.
Referring to FIG. 18, this special object is herein called a Privileged Operation Object 930. If a user (i.e., thread) has access to a particular Privileged Operation Object, then the user is allowed to perform the corresponding operation 932. If a user does not have access to a particular Privileged Operation Object, then the user is not allowed to perform the corresponding operation.
Thus, a Privileged Operation Object represents a privileged operation. Each privileged operation that does not inherently reference an object has a privileged operation object associated with it. The name assigned to the privileged operation object is usually the name of the privileged operation. The ACL 934 on the privileged operation object determines the users who can perform the privileged operation.
More specifically, a user must have PERFORM OPERATION access to the privileged object in order to perform the corresponding privileged operation. This means that (1) the routine 932 which runs the privileged operation verifies access (box 936) to a specific one of the access types for the privileged operation object (i.e., an object specific type of access), (2) the privileged operation object has an ACL which lists one or more identifiers needed for the specified type of access, and thus (3) the user's ID list 938 must include the identifier(s) listed in the ACL in order to be able to user the privileged operation. PERFORM OPERATION access means having identifier(s) which match those in the ACL for the Privileged Operation Object.
For example, the object used to control access to the routine for setting the system's clock is called the SET.sub.-- SYSTEM.sub.-- TIME privileged operation object. A user must have PERFORM OPERATION access to the SET.sub.-- SYSTEM.sub.-- TIME privileged operation object in order to set the system's clock. This means that the user's ID list must contain all the identifiers included in the access ACE which governs PERFORM OPERATION access to the SET.sub.-- SYSTEM.sub.-- TIME privileged operation object.
A privileged operation object is created by calling a object creation service routine which uses the OTD for Privileged Operation Objects to create a new object. Note that the length of the object body of Privileged Operation Objects is zero. The creator of the object inserts in the object an ACL which defines the identifier(s) needed in order to have PERFORM OPERATION access to the object. All Privileged Operation Objects are stored in a specific system level container called the Privileged Operation Container 939.
Privileged Operation Objects are a distinct object type, and thus have a distinct OTD 940 (object type descriptor) which defines the format and routines which support this object type. The ACL 942 for the Privileged Operation Object OTD has an object specific access type, called CREATE OBJECT access. See the above discussion for object specific access types.
Only users 944 with CREATE OBJECT access (see Table 2) to the Privileged Operation Object OTD are allowed to create Privileged Operation Objects. Thus the ACL mechanism for Privileged Operation Object OTD prevents the proliferation of privileged operation objects that might otherwise be created by unauthorized users. More specifically, a special identifier called CREATE PRIVILEGED OPERATION OBJECT is included in an Access Control Entry for the ACL 942 for the Privileged Operation Object OTD 940. Only users 944 who have this special identifier in their ID list 946 are allowed to generate new privileged operation objects. Conceptually, the OTD for privileged operation objects can be considered to be a special type of privileged operation object--because it protects the privileged operation of generating new privileged operation objects.
OBJECT ALLOCATION
An object may be allocated to a user object, job object, process object or thread object. Generally, the purpose of object allocation is to give a particular user, job, process or thread exclusive user of a particular system resource. For instance, an object representing a computer terminal may be allocated to a specified job object. An object may also be allocated to an "allocation identifier object", which is a special type of object that is used to give a predefined set of users exclusive access to a system resource, such as a tape drive. Object allocation differs from the access control lists in that object allocation prevents access by threads which would otherwise be authorized to access a particular object according to the object's ACL.
The visibility level of an object determines the level of the allocation "class" (i.e., visibility level of the allocation object) to which the object can be allocated. For instance, an object at the system level can be allocated to any of the five types of allocation classes (user, job, process, thread, or allocation identifier), but an object at the process level of visibility can only be allocated to process and thread objects.
Referring to FIG. 16, when a object 900 is allocated an allocation block 902 is created and the allocation block 902 is linked into a list of allocation blocks 905 for the allocation object 908 to which the object 900 has been allocated. When an object 900 is allocated, a pointer to the allocation block 902 is stored in the header of the allocated object 900.
The list head 910 for the list of allocation blocks 905 is stored in the body of the allocation object 908, at the position in the object body specified by the Allocation List Head Offset field 389 in the allocation object's header (see FIG. 8).
Each allocation block 902, 912, 914 contains a forward link 920 and a backward link 922 for forming a doubly linked list 905 of allocation blocks. An allocation type field 924 indicates whether the allocation object is a user object, job object, process object, thread object, or an allocation identifier object. The allocation ID field 926 contains the ID of the allocation object 908, and the object pointer field 928 points to the header of the object that has been allocated.
Note that an object cannot be allocated unless its object ID count is equal to one, because the existence of one or more outstanding reference IDs indicates that other threads need access to the object.
Whenever a thread attempts to access an object by translating an object ID, the access checking routine checks to see if the allocation block pointer in the object header has a non-zero value. If so, this indicates that the object ID refers to an object that has been allocated.
It then checks to see if the object has been allocated to an object that corresponds to the thread. If so, access is allowed, otherwise it is denied.
WAITABLE OBJECTS
Computer applications and operating systems often need synchronization mechanisms to help coordinate access to resources or data. The present invention provides a set of "kernel synchronization primitives", which are incorporated in "waitable objects" for synchronizing processes with specified events. Waitable objects are user accessible objects which can be "waited on"--which means that a thread can be suspended until the status of the waitable object is changed to a predefined state called "signalled".
As will be discussed below, the present invention enables users not only to generate new instances of predefined types of waitable objects, but it also allows users to define new types of waitable objects without having to modify the wait service routines and the scheduler in the operating system's kernel. Thus users of the system can create customized waitable objects without having any detailed understanding of how the kernel's wait servicing software works.
Referring to FIG. 20, when an object 950 is designated as a waitable object, then its object body 952 includes a kernel synchronization primitive 954. The position of the kernel synchronization primitive 954 in the object body 952 is specified by the dispatcher pointer 381 in the object's header.
Kernel synchronization primitives, which are sometimes called dispatcher objects or kernel synchronization objects, and the objects in which they reside, are defined to be in one of two states: Unsignalled, or Signalled.
This states are said to be the signal state of the object of kernel synchronization primitive.
The system provides executive wait service routines 956 and kernel wait service routines 960 for use by programs needing to synchronize activities. These service routines will be discussed in more detailed below.
The preferred embodiment provides four types of kernel synchronization primitives that can be used in user accessible objects. These primitives are as follows.
A notification event remains signalled until explicitly unsignalled.
A synchronization event, once signalled, remains signalled until a wait is satisfied. Satisfaction of a wait automatically changes the state to unsignalled.
A semaphore is used to control limited, but not exclusive, access to a resource. A semaphore is created with an initial count. As long as that count is non-zero, then the semaphore is signalled. The count is decremented each time a wait on the semaphore is satisfied.
A timer is used to wait for a specific amount of time to pass. A timer contains an expiration time. Initially, a timer is unsignalled. When the expiration time occurs, the timer is changed to signalled.
Mutexes are the kernel synchronization primitive used to control exclusive access to a resource. The state of a mutex is controlled by a count. When the count is 1 (signalled state), the mutex is not owned and access to the resource associated with the mutex can be allowed. Granting ownership of a mutex causes the count to be decremented to 0 (unsignalled state), whereupon no other thread is able to gain access to the resource until the owner thread releases the mutex. Waiting on (acquiring) a mutex suspends the execution of the invoking thread until the mutex count is 1. Satisfying the Wait causes the count to be decremented to 0 and grants ownership of the mutex to a waiting thread. Mutexes, generally, cannot be incorporated into the body of a user accessible object in order to form a waitable object. This is because mutexes must be used only in contexts where the mutex is held for short periods of time. Notification and synchronization events are used in contexts where a thread will need exclusive access to a system resource for a longer period of time.
Wait regards are requests by threads to be synchronized with a specified waitable object by suspending the thread until the specified waitable object is signalled. The kernel synchronization primitive 954 (in the waitable object 950) includes a Wait Type field 962 which specifies the type of the kernel synchronization primitive. A Wait Status field 964 which indicates whether the kernel synchronization primitive is signaled or unsignalled, and also stores such parameters as the count for a semaphore and the expiration time for a timer. A wait list head 966 points to a list 970 of wait references 972, 974. Each wait reference denotes one thread 976 which is waiting on the kernel synchronization primitive.
The kernel wait service routines 960 includes the following routines for controlling the state of kernel synchronization primitives. Set.sub.-- Event is used to set the state of either a notification or synchronization event to signalled. Clear.sub.-- Event is used to set the state of either a notification or synchronization event to unsignalled.
Pulse.sub.-- Event is used to set the state of either a notification or synchronization event to signalled and then immediately changes it to signalled. When used with a notification event, this has the effect of satisfying all current wait requests, while preventing future requests from being satisfied.
Release.sub.-- Semaphore is used to cause the semaphore's count to be incremented. If the count is incremented from zero to one, then the state of the semaphore is changed to signalled.
Set.sub.-- Timer is used to set the expiration time of a timer kernel synchronization primitive. This causes the timer to become unsignalled.
When a wait operation is to be performed by a user process on one or more specified waitable object instances 950, the user process calls one of two execute wait service routines 956: "Executive Wait Single" or "Executive Wait Multiple". These executive wait service routines accept the object IDs of one or more waitable objects. Executive Wait Single suspends the issuing program until a specified waitable object becomes signalled. Executive Wait Multiple can be used to wait on two or more specified waitable objects. The Executive Wait Multiple routine has two modes of operation which can be specified by the user: it either (1) suspends the issuing program until any of the specified waitable objects becomes signalled, or (2) suspends the issuing program until all of the specified waitable objects become signalled. A timeout value may also, optionally, be supplied to indicate that if the wait has not completed after the timeout has expired, the program should resume anyway.
The kernel wait service routines 960 include two corresponding routines: "Wait Single" and "Wait Multiple". The difference between the executive and kernel versions of these routines is that the executive routines are called by a process which specifies the object IDs of one or more waitable objects, while the kernel routines are called by the executive which specifies pointers to kernel synchronization primitives that are to be waited on.
When a user process calls one of the executive wait routines it specifies the object ID(s) of the waitable object(s) that it wants to wait on. The executive wait routine translates each specified object IDs into an object pointer, and then inspects the Dispatcher Pointer 381 in the referenced object to make sure that the object is a waitable object. If the Dispatcher Pointer is not nil, the referenced object is a waitable object. The executive then calls one of the kernel wait routines 960 to perform a kernel wait operation on the kernel synchronization primitive 954 pointed to by the Dispatcher Pointer 381.
When a wait request completes normally (that is, does not time-out) the wait is said to have been satisfied.
Waitable objects are created by storing the data structure for an kernel synchronization primitive in the object body of an object instance (at an position in the object body specified by the Dispatcher Offset field 410 of the OTD for this object type), setting the Dispatcher Pointer 381 in the object header to point to the kernel synchronization primitive, and then calling a corresponding kernel service routine for initializing the dispatcher object. Once initialized, the kernel synchronization primitive can then be manipulated by using other kernel wait service routines.
As discussed above with reference to FIG. 10, it is a feature of the present invention that there is a simple procedure for defining new types of objects and a corresponding set of object type-specific routines for interacting with the system. As shown in FIG. 10, all OTDs are objects stored in a system level container 460 called the OTD Container. To define an new type of waitable object the same procedure is used as for creating other object types. The primary special considerations for creating new types of waitable objects are as follows.
The OTD for a new type of waitable object must provide a non-negative dispatcher offset 410 which specifies the position of a kernel synchronization primitive in the object body. In addition, the routing 440 for creating new instances of this object type must store the data structure for an kernel synchronization primitive in the object body of an object instance, set the Dispatcher Pointer 381 in the object header to point to the kernel synchronization primitive, and then call a corresponding kernel service routing for initializing the dispatcher object. Finally, if the new type of waitable object needs to be explicitly signalled or unsignalled by user mode programs, the creator of the new waitable object type must provide an executive interface that can be called by user mode threads. The executive interface for the waitable object comprises one or more executive wait service routines which call the appropriate kernel wait service routines for signalling and unsignalling specified waitable objects of this type.
For example, it would be possible to create a new type of waitable object called a Waitable Privileged Operation Object. In this example, a semaphore kernel synchronization primitive would be incorporated in the Waitable Privileged Operation Object. The purpose of making a Waitable Privileged Operation Object that incorporates a semaphore would be to limit the number of users which simultaneously perform a particular privileged operation. To perform this particular privileged operation, a user would have to wait on the privileged operation object until the semaphore's count value is non-zero.
ALTERNATE EMBODIMENTS
While the present invention has been described with reference to a few specific embodiments, the description is illustrative of the invention and is not to be construed as limiting the invention. Various modifications may occur to those skilled in the art without departing from the true spirit and scope of the invention as defined by the appended claims.
Claims
What is claimed is:
1. For use in a computer system having a central processing unit and memory means for storing data and data structures, an operating system comprising: a multiplicity of different types of objects comprising data structures stored in said memory means; said multiplicity of data structures including a multiplicity of different types of synchronization data structures; said multiplicity of different types of objects including waitable object types, each of a multiplicity of said objects comprising waitable objects incorporating one of said synchronization data structures; each synchronization data structure incorporated in one of said waitable objects enabling an operating system handled thread of execution to wait on said waitable object, said synchronization data structure including status means denoting the status of said synchronization data structure as Signalled or Unsignalled; waitable object generating means, responsive to requests from operating system handled threads of execution, for creating ones of said waitable objects; wherein, said waitable object generating means stores said synchronization data structure incorporated in each waitable object at a memory location determinable by a uniform rule applicable to all of said types of waitable objects; wait requesting means for suspending a specified operating system handled thread of execution until the status of a specified one of said waitable objects is Signalled; wait service means for changing the status of a specified one of said waitable objects to Signalled; a multiplicity of object type descriptors, each object type descriptor means having means for specifying the format of a distinct one of said different types of said objects; a multiplicity of object service means, including an object service means for each said object type for performing predefined operations on objects of said object type; each said object type descriptor means including means for specifying one of said object service means corresponding to one of said object types; and means for adding to said operating system an additional object type descriptor means corresponding to an additional type of waitable object, including means for specifying one of said object service means for said additional waitable object type and for specifying one of said different types of synchronization data structure to be incorporated in waitable objects of said additional waitable object type; whereby an additional waitable object type can be added to said operating system by adding a corresponding object type descriptor.
2. The operating system of claim 1, wherein a multiplicity of said operating system handled threads of execution each executes in separate address space associated with a corresponding separate process.
3. For use in a computer system having a central processing unit and memory means for storing data and data structures, a method of operating the computer system comprising the steps of: providing a multiplicity of different types of synchronization data structures; providing a multiplicity of objects comprising data structures, each object being of one of a multiplicity of different object types; said multiplicity of different types of objects including waitable object types, each waitable object incorporating one of said multiplicity of different types of synchronization data structures, enabling operating system handled threads of execution to wait on each said waitable object; denoting the status of each of said waitable object as Signalled or Unsignalled; creating ones of said waitable objects in response to requests from operating system handled threads of execution, including storing said synchronization data structure incorporated in each waitable object at a memory location determinable by a uniform rule applicable to all of said waitable object types; suspending a specified operating system handled thread of execution until the status of a specified one of said waitable objects is Signalled; changing the status of a specified one of said waitable objects to Signalled; specifying the format of a distinct one of said different types of said objects in an object type descriptor specifying an object type service means corresponding to one of said object types; performing predefined operations on objects of each said object type using object service means for said each object type; and generating an additional waitable object type, including specifying object service means for said additional waitable object type, and specifying one of said different types of synchronization data structures to be incorporated in waitable objects of said additional waitable object type; whereby an additional waitable object type can be added to said computer system.
4. The operating system method of claim 3, wherein a multiplicity of said operating system handled threads of execution each executes in separate address space associated with a corresponding separate process.
5. A memory for storing data for access by programs being executed on a data processing system, comprising: a computer operating system, stored in said memory, for managing processes and resources in a computer system, said computer system having waitable resources, non-waitable resources, and processes that request services of said resources, each waitable one of said resources capable of causing said processes to wait when requesting service therefrom, and each non-waitable one of said resources not causing said processes to wait when requesting service therefrom; said computer operating system including: a plurality of resource data structures stored in said memory, one said resource data structure for use in managing each said resource, said plurality of resource data structures including waitable and non-waitable resource data structures for use in managing waitable and non-waitable resources, respectively; said resource data structures being of a plurality of data types, each said data type having a body format distinct from the body format of other said data types; each waitable resource data structure having a corresponding dispatcher datum at a memory location determinable by a uniform rule applicable with respect to said data types; said dispatcher datum corresponding to each said waitable resource data structure indicating a waiting state for those of said processes, if any, waiting for service from the corresponding waitable resource; and wait service means for managing said waitable resources in conjunction with said waitable resource data structures by causing said processes to wait when requesting services from said waitable resources, allowing ones of said processes to utilize said waitable resources when associated wait conditions are met, and updating said wait state for each said waitable resource.
6. The memory of claim 5, each non-waitable resource data structure having a corresponding dispatcher datum at a memory location determinable by said uniform rule applicable with respect to said data types; wherein said dispatcher datum corresponding to each said non-waitable data structure indicates that said each non-waitable data structure does not manage a waitable resource.
7. The memory of claim 5, further comprising: at least two object type descriptors specifying data structure formats for two of said waitable resource data structures data types; said object type descriptors each including a predefined field specifying how to locate in said memory said dispatcher datum corresponding to waitable resource data structures of a corresponding one of said data types; and said uniform rule includes accessing said predefined field in said respective object type descriptor and accessing a location in said memory specified by said predefined field in said respective object type descriptor.
8. The memory of claim 5, wherein said plurality of data structures include at least one object type descriptor specifying a data structure format for said non-waitable data structures and at least one object type descriptor specifying a data structure format for said waitable data structures; said object type descriptors each including a predefined field specifying how to locate in said memory said dispatcher datum associated with each non-waitable data structure and said dispatcher datum associated with each waitable data structure; and said uniform rule includes accessing said predefined field in said respective object type descriptor, determining whether said predefined field stores a value indicative of a waitable data structure, and when said predefined field stores a value indicative of a waitable data structure, accessing a location in said memory specified by said predefined field in said respective object type descriptor.
9. The memory of claim 5, said non-waitable data structures and said waitable data structures including header data structures having substantially similar data structure formats; a pointer to said dispatcher datum for each said non-waitable and waitable data structure being located at like predefined positions in said header data structures of said header data structures for said each non-waitable and waitable data structure; and said uniform rule including accessing said predefined position in said header data structure and accessing a location in said memory specified by said pointer in said header data structure.
10. A computer system, comprising: waitable resources and non-waitable resources; threads of execution that request services of said resources; a waitable one of said resources causing said threads of execution to wait when requesting service therefrom, and a non-waitable one of said resources not causing said threads of execution to wait when requesting service therefrom; computer memory means; a plurality of data structures stored in said computer memory means, one said data structure managing each of said resources, said plurality of data structures including waitable and non-waitable data structures for managing waitable and non-waitable resources, respectively; each data structure for use in managing one resource having an associated datum at a computer memory location determinable by a uniform rule with respect to said each data structure; said datum associated with each non-waitable data structure indicating that said each non-waitable data structure does not manage waitable resources; said datum associated with each said waitable data structure indicating a waiting state with respect to specified ones of said threads of execution; and wait service means for accessing said datum associated one of said waitable data structures in accordance with said uniform rule when any thread of execution requests service from the corresponding waitable resource, and for causing said any thread of execution to wait when requesting services from said waitable resource until an associated wait termination condition is met, and updating said wait state for said waitable resource.
11. The computer system of claim 10, wherein said plurality of data structures include at least one object type descriptor specifying a data structure format for said non-waitable data structures and at least one object type descriptor specifying a data structure format for said waitable data structures; said object type descriptors each including a predefined field specifying how to locate in said computer memory means said datum associated with each non-waitable data structure and said datum associated with each waitable data structure; said uniform rule including accessing said predefined field in said respective object type descriptor and accessing a location in said computer memory means specified by said predefined field in said respective object type descriptor.
12. The computer system of claim 10, said non-waitable data structures and said waitable data structures including header data structures having substantially similar data structure formats; a pointer to said dispatcher datum for each said non-waitable and waitable data structure being located at like predefined positions in said header data structures of said header data structures for said each non-waitable and waitable data structure; and said uniform rule including accessing said predefined position in said header data structure and accessing a location in said computer memory means specified by said pointer in said header data structure.
13. A method of modifying an operating system for use in a computer system having a central processing unit and memory means for storing data and data structures, comprising the steps of: (1) installing an initial operating system that includes: (1a) a process manager for managing the execution of a plurality of processes; (1b) a multiplicity of objects, each of said objects comprising an instance of a data structure, wherein said multiplicity of objects are partitioned into a multiplicity of object types, including waitable object types; (1c) for each object type, an object type descriptor and at least one object service means for performing predefined operations on objects of the object type; each said object type descriptor specifying the format of objects of a corresponding one of said object types and including means for specifying one of said object service means associated with said corresponding object type; (1d) a multiplicity of different types of synchronization data structures, each synchronization data structure having a status of Signalled or Unsignalled; (1e) a multiplicity of said objects comprising waitable objects, each having embedded therein one of said synchronization data structures, thereby enabling ones of said processes to wait on said waitable object; (1f) waitable object generating means, responsive to requests from said processes, for creating new instances of waitable objects; wherein, said waitable object generating means stores said synchronization data structure embedded in each waitable object at a memory location determinable by a uniform rule applicable to all of said waitable objects types; (1g) wait requesting means for suspending a specified one of said processes until the status of a specified one of said synchronization data structures and its associated waitable object is Signalled; (1h) wait service means for changing the status of a specified one of said synchronization data structures and its associated waitable object to Signalled; (2) adding to said initial operating system an additional waitable object type, said adding step including: (2a) adding to said initial operating system object service means for said additional waitable object type; (2b) specifying one of said different types of synchronization data structures to be associated with waitable objects of said additional waitable object type; and (2c) generating an additional object type descriptor for said additional object type; whereby an additional waitable object type is added to said initial operating system.
14. An operating system for use in a computer system having a central processing unit and memory means for storing data and data structures, comprising: (1) an initial operating system, stored in said memory means, that includes: (1a) a process manager for managing the execution of a plurality of processes; (1b) a multiplicity of objects, each of said objects comprising an instance of a data structure, wherein said multiplicity of objects are partitioned into a multiplicity of object types, including waitable object types; (1c) for each object type, an object type descriptor and at least one object service means for performing predefined operations on objects of the object type; each said object type descriptor specifying the format of objects of a corresponding one of said object types and including means for specifying one of said object service means associated with said corresponding object type; (1d) a multiplicity of different types of synchronization data structures, each synchronization data structure having a status of Signalled or Unsignalled; (1e) a multiplicity of said objects comprising waitable objects, each having embedded therein one of said synchronization data structures, thereby enabling ones of said processes to wait on said waitable object; (1f) waitable object generating means, responsive to requests from said processes, for creating new instances of waitable objects; wherein, said waitable object generating means stores said synchronization data structure embedded in each waitable object at a memory location determinable by a uniform rule applicable to all of said waitable objects types; (1g) wait requesting means for suspending a specified one of said processes until the status of a specified one of said synchronization data structures and its associated waitable object is Signalled; (1h) wait service means for changing the status of a specified one of said synchronization data structures and its associated waitable object to Signalled; (2) means for adding to said initial operating system an additional waitable object type, including means for adding: (2a) object service means for said additional waitable object type; (2b) means for specifying one of said different types of synchronization data structures to be associated with waitable objects of said additional waitable object type; and (2c) an additional object type descriptor for said additional object type; whereby an additional waitable object type is added to said initial operating system.
15. A method of modifying an operating system for use in a computer system having a central processing unit and memory means for storing data and data structures, comprising the steps of: (1) providing an initial operating system that includes: (1a) thread management means for managing the execution of a plurality of threads of execution; (1b) a multiplicity of objects, each of said objects comprising an instance of a data structure, wherein said multiplicity of objects are partitioned into a multiplicity of object types, including waitable object types; (1c) for each object type, an object type descriptor and at least one object service means for performing predefined operations on objects of the object type; each said object type descriptor specifying the format of objects of a corresponding one of said object types and including means for specifying one of said object service means associated with said corresponding object type; (1d) a multiplicity of different types of synchronization data structures, each synchronization data structure having a status of Signalled or Unsignalled; (1e) a multiplicity of said objects comprising waitable objects, each having incorporated therein one of said synchronization data structures, thereby enabling ones of said threads of execution to wait on said waitable object; (1f) waitable object generating means, responsive to requests from said threads of execution, for creating new instances of waitable objects; wherein, said waitable object generating means stores said synchronization data structure incorporated in each waitable object at a memory location determinable by a uniform rule applicable to all of said types of waitable objects; (1g) wait requesting means for suspending a specified one of said threads of execution until the status of a specified one of said synchronization data structures and its associated waitable object is Signalled; (1h) wait service means for changing the status of a specified one of said synchronization data structures and its associated waitable object to Signalled; (2) adding to said initial operating system an additional waitable object type, said adding step including: (2a) adding to said initial operating system object service means for said additional waitable object type; (2b) specifying one of said different types of synchronization data structures to be associated with waitable objects of said additional waitable object type; and (2c) generating an additional object type descriptor for said additional object type; whereby an additional waitable object type is added to said initial operating system.
16. An operating system for use in a computer system having a central processing unit and memory means for storing data and data structures, comprising: (1) an initial operating system, stored in said memory means, that includes: (1a) thread management means for managing the execution of a plurality of threads of execution; (1b) a multiplicity of objects, each of said objects comprising an instance of a data structure, wherein said multiplicity of objects are partitioned into a multiplicity of object types, including waitable object types; (1c) for each object type, an object type descriptor and at least one object service means for performing predefined operations on objects of the object type; each said object type descriptor specifying the format of objects of a corresponding one of said object types and including means for specifying one of said object service means associated with said corresponding object type; (1d) a multiplicity of different types of synchronization data structures, each synchronization data structure having a status of Signalled or Unsignalled; (1e) a multiplicity of said objects comprising waitable objects, each having incorporated therein one of said synchronization data structures, thereby enabling ones of said threads of execution to wait on said waitable object; (1f) waitable object generating means, responsive to requests from said threads of execution, for creating new instances of waitable objects; wherein, said waitable object generating means stores said synchronization data structure incorporated in each waitable object at a memory location determinable by a uniform rule applicable to all of said types of waitable objects; (1g) wait requesting means for suspending a specified one of said threads of execution until the status of a specified one of said synchronization data structures and its associated waitable object is Signalled; (1h) wait service means for changing the status of a specified one of said synchronization data structures and its associated waitable object to Signalled; (2) means adding to said initial operating system an additional waitable object type, including means for adding: (2a) service means for said additional waitable object type; (2b) means for specifying one of said different types of synchronization data structures to be associated with waitable objects of said additional waitable object type; and (2c) an additional object type descriptor for said additional object type; whereby an additional waitable object type is added to said initial operating system.
17. A method of adding to a pre-existing computer operating system support for managing a resource, the resource imposing a latency on any thread of execution requesting service therefrom, the computer system having a memory means for storing data and data structures, the method comprising the steps of: defining a data structure type corresponding to the resource, said data structure type sharing with pre-existing resource data structure types of said computer operating system a common header format, said defined data structure type having an associated body format; said common header format including a dispatcher datum whose value indicates an address in said memory means of a synchronization data structure for use in managing the waiting said any thread of execution waiting on said resource; and adding to said pre-existing computer operating system said defined data structure, and adding object service routines for manipulating data structures of said defined data structure type to form a modified computer operating system, said object service routines including means for causing any thread of execution to wait when requesting services from said resource until an associated wait termination condition is satisfied and for updating ones of said synchronization data structures accordingly.
18. The method of claim 17, including compiling said modified operating system into an executable operating system.
19. The method of claim 17, said step (2) including writing operating system source code incorporating said defined data structure type and said object service routines, and compiling said operating system source code into an executable operating system.
20. A method of adding to a pre-existing computer operating system support for managing resources of a new resource class, the resources of the new resource class imposing a latency on any thread of execution requesting service therefrom, the computer operating system operating in a computer system having a memory means for storing data and data structures, the pre-existing computer operating system managing resources of a plurality of pre-existing resource classes, each said pre-existing resource class having a corresponding pre-existing data structure type, the method comprising the steps of: defining a new data structure type corresponding to the new resource class, said data structure type sharing with said pre-existing resource data structure types a common header format, each said data structure type having a distinct associated body format; said common header format including a dispatcher datum whose value indicates an address in said memory means of a synchronization data structure for use in managing the waiting of said any thread of execution waiting on said resource; and adding to said pre-existing computer operating system said new data structure type, and adding object service routines for manipulating data structures of said new data structure type to form a modified computer operating system, said object service routines including means for causing any thread of execution to wait when requesting services from said resource until an associated wait termination condition is satisfied and for updating ones of said synchronization data structures accordingly.
21. The method of claim 20, including compiling said modified operating system into an executable operating system.
22. For use in a computer system, a method of managing resources of the computer system, the resources partitioned into resource classes, the resource classes being divided into waitable and non-waitable classes, the method comprising the steps of: for each resource, allocating storage for a resource data structure for use in managing said each resource, said resource data structures being partitioned into object classes corresponding to said resource classes, said object classes including waitable and non-waitable object classes, each object class comprising a corresponding data structure format and at least one corresponding object service routine for performing predefined operations on resource data structures of said object class, the data structure formats for said object classes sharing a common header format; for each said object class, allocating storage for an object type descriptor corresponding to said object class, each object type descriptor comprising data indicating said data structure format and said at least one object service routine corresponding to said object class; setting a type pointer member in the header of each said resource data structure to point to the corresponding object type descriptor; launching a plurality of processes for execution; incorporating in each said resource data structure corresponding to a waitable one of said resources a synchronization data structure, each synchronization data structure having a status of Signalled or Unsignalled and having a datum for indicating processes waiting on said synchronization data structure; said incorporating step including storing said synchronization data structure incorporated in each resource data structure at a memory location determinable by a uniform rule applicable to all of said waitable object classes; when one of said processes requests service from one of said waitable resources, setting to Unsignalled the status of the synchronization data structure associated with the resource data structure corresponding to said one waitable resource, and suspending said one process until the status of the associated synchronization data structure is Signalled; and when a wait condition for said waitable resource is satisfied, changing the status of said corresponding synchronization data structure to Signalled.
23. The method of claim 22, wherein each said dispatcher datum associated with each said resource data structure is stored in the corresponding object type descriptor.
24. In an operating system for a computer, a method for processing a request by a process for a service from one of a plurality of resources of said computer, the service having a latency time during which the process must wait pending completion of the service, the steps of the method comprising: locating a resource data structure, corresponding to the one resource from the service requested, from among a plurality of resource data structures each corresponding to one of said plurality of resources and used by said operating system for use in managing the corresponding resource, each of said resource data structures belonging to one of a plurality of object classes, each object class having a data structure format and at least one object service routine for performing predefined operations on resource data structures of said each object class; locating a synchronization data structure for said resource data structure by means of a rule uniformly applicable to said resource data structures of all said object classes, said synchronization data structure specifying a synchronization protocol associated with said service; suspending execution of the process according to said synchronization protocol, and storing in association with said synchronization data structure process control data for resuming execution of the process; and when said synchronization protocol is satisfied, resuming execution of the process according to said process control data.
Patent Citations (18)
| Patent | Date | Inventor | Cited By |
|---|---|---|---|
| US4152761 | 1979-05-01 | Louie | |
| US4189771 | 1980-02-01 | Roever | |
| US4286322 | 1981-08-01 | Hoffman et al. | |
| US4320451 | 1982-03-01 | Bachman et al. | |
| US4399504 | 1983-08-01 | Obermarck et al. | |
| US4442484 | 1984-04-01 | Childs, Jr. et al. | |
| US4604694 | 1986-08-01 | Hough | |
| US4642756 | 1987-02-01 | Sherrod | |
| US4658351 | 1987-04-01 | Teng | |
| US4713656 | 1987-12-01 | Cliff et al. | |
| US4815030 | 1989-03-01 | Cross et al. | |
| US5057996 | 1991-10-01 | Cutler et al. | |
| US5129083 | 1992-07-01 | Cutler et al. | |
| US5129084 | 1992-07-01 | Kelly, Jr. et al. | |
| US5136712 | 1992-08-01 | Petrazzoli et al. | |
| US5187790 | 1993-02-01 | East et al. | |
| US5297283 | 1994-03-01 | Kelly, Jr. et al. | |
| US5321841 | 1994-06-01 | East et al. |
Non-Patent Literature (26)
- ACM Operating Systems Review; "Proceedings of the Fifth Symposium on Operating Systems Principles"; vol. 9, No. 5; Nov. 1975.
- Usenix Association, Distributed & Multiprocessor Systems (SEDMS II), Dept. of Computer Science, Purdue University "Process Scheduling and Synchronization in the Renaissance Object-Oriented Multiprocessor Operating System", Vincent F. Russo; pp. 117-131.
- Dept. of Computer Science, Katholieke Universiteit Leuven; "A Portability Platform for Distributed Application Programming"; H. Moons, P. Verbaeten; pp. 269-272.
- University of Queensland, "Fundamentals of Operating Systems", A. M. Lister, M.A., 1979,pp. 23-40.
- Carnegie-Mellon Univ., "Hydra, Kernel Reference Manual", E. Cohen, B. Corwin, D. Jefferson, T. Lane, R. Levin, J. Newcomer, F. Pollack, B. Wulf, Nov. 1976.
- Carnegie-Mellon Univ., "The Implementation and Evaluation of Parallel Algorithms on C.MMP", P. N. Oleinick, Nov. 1978, pp. 1-97.
- "HYDRA-C.mmp, An Experimental Computer System", W. A. Wulf, R. Levin, S. P. Harbison, 1981, pp. 1-297.
- IEEE, "NAXOS: An Operating System Nucleus for Microprocessors", Y. Yano, H. Takahashi, H. Monden, K. Tanabe, VLSI Dev. Div., 1982, pp. 277-281.
- Computer Design, "System Design/Software, VAX Executive Develops Realtime Applications", Roger Heinen, Jr., Mar. 1984, pp. 79-91.
- Stanford Univ. and Distributed Systems Group, "V-System 6.0 Reference Manual, " D. R. Cheriton and Keith A. Lantz, Principal Investigators, Jul. 1986.
- IEEE Micro, Stanford Univ., "Operating Systems, An Introduction to the V-System", E. Berglund, Aug. 1986, pp. 35-52.
- UMI Dissertation Services, Carnegie-Mellon Univ., "Operating System/Application Concurrency in Tightly-Coupled Multiple-Processor Systems", James Wallace, 1987.
- Electronics, "Here comes High-Powered Unix for Multiple CPUs", by L. Curran, Oct. 1987, pp. 77-79.
- Softward--Practice and Experience, vol. 18(8), 713-732, "PRESTO: A System for Object-oriented Parallel Programming", B. Bershad, E. Lazowska, H. Levy, Aug. 1988.
- Communications of the ACM, "The V Distributed System", by D. Cheriton, vol. 31, No. 3, pp. 314-333.; Mar. 1988.
- OOPSLA '88 Proceedings, Univ. of Ill., "Process Management and Exception Handling in Multiprocessor . . . ", V. Russo, G. Johnston, R. Campbell, Sep. 1988, pp. 248-258.
- Computer, No. 12, "Inheritance of Synchronization and Recovery Properties in Avalon/C++", D. Detlefs, M. Herlihy, J. Wing, Dec. 1988, pp. 57-69.
- IEEE, "Experience with object-based distributed computation in the Guide operating system", R. Balter, et al., 1989, pp. 16-19.
- IEEE, "Operating System Support for an Object-Oriented Environment", P. Guedes and J. Marques, 1989, pp. 37-42.
- DEC Professional, "The Battle for UNIX Standards", L. Haber, Feb. 1989, pp. 48-55.
- Software Practice and Experience, "An Implementation of the Object-oriented Concurrent . . . ", A. Tripathi, E. Berge, M. Aksit,vol. 19(3), Mar. 1989, pp. 235-256.
- "Operating System Kernel for Fault Tolerant Multiprocessor System", M. Bojovic, Z. Konstantinovic, M. Kovacevic, pp. 70-73.
- Carnegie-Mellon Univ., "Overview of the Hydra Operating System Development", W. Wulf, R. Levin, C. Pierson, pp. 122-131.
- Carnegie-Mellon Univ., "Protection in the Hydra Operating System", E. Cohen and D. Jefferson, pp. 141-160.
- Carnegie-Mellon Univ., "Policy/Mechanism Separation in Hydra", R. Levin, E. Cohen, W. Corwin, F. Pollarck, W. Wulf, pp. 132-140.
- "Recovery Management in a Transaction Oriented Distributed Operating System", J. Kaiser, R. Kroger, E. Nett, pp. 125-140.