US 7,552,153 B2Grant
Virtual machine monitoring using shared memory
Issue Date:2009-06-23
•16 Claims
•8 Drawing Sheets
Abstract
A system and method to monitor a virtual machine VM. The VM executes one or more applications. During executing of the one or more applications, local objects are created and stored within an internal heap maintained by the VM. Status data of the internal heap is published to monitoring memory external to the VM.
Metadata
Assignee
- SAP AG
Inventors
- Jan Dostert
- Christian Fleischer
- Frank Kilian
- Randolf Werner
Application Information
Application Number:US 11/024,393
Filing Date:2004-12-28
Priority Date:2004-12-28
Art Unit:2162
Classifications
IPC:
G06F17/30
Patent Drawings (8 sheets)
Description
Technical Field
[0001] This disclosure relates generally to virtual machines, and in particular but not exclusively, relates to monitoring java virtual machines.
Background Information
[0002] Enterprise software has transformed the way diverse enterprises, large and small a like, transact and manage day-to-day operations. Businesses use enterprise software (e.g., web based application servers) to control production planning, purchasing and logistics, warehouse management and inventory management, production, vendor management, customer service, finance, personnel management, and other basic business activities. As the enterprise software industry continues to mature, the various application and hardware resources enlisted to facilitate this diverse set of tasks are being amalgamated into robust, highly integrated solutions (e.g., SAP NetWeaver, SAP xAPPs, mySAP Business Suite, etc.).
[0003] To integrate diverse hardware and software resources, developers of enterprise software have leveraged cross platform engines capable of minimizing or even severing platform dependencies from the enterprise solution. The Java 2 Platform, Enterprise Edition™ (“J2EE”) (e.g., J2EE Specification, Version 1.4) is a Java based solution supported by the Java Virtual Machine (“JVM”) engine. J2EE simplifies application development and decreases the need for programming and programmer training by creating standardized and reusable modular components. The popularity of Java based solutions is evident as the Information Technology (“IT”) world has gravitated to the Java language.
[0004] As enterprise software is woven into the fabric of modern business, failure of an enterprise solution may no longer be a mere nuisance, but has the potential to wreak catastrophic havoc on a business. As such, robust, reliable software is evermore critical. The enterprise software industry is marching toward the ultimate goal of self-healing software capable of sustainable, uninterrupted operation, without human intervention. In pursuit of this goal, IT technicians can benefit from convenient tools capable of monitoring the health of their enterprise software. With appropriate monitoring tools, IT technicians can take appropriate action in a timely manner to ensure a healthful state of their software or to spot delinquent applications and prevent repeat offenders. Currently, JVMs do not provide adequate tools to monitor their internal operation on a real-time basis.
Summary of Invention
[0005] A system and method to monitor a virtual machine (“VM”) is described. The VM executes one or more applications. During executing of the one or more applications, local objects are created and stored within an internal heap maintained by the VM. Status data of the internal heap is published to monitoring memory external to the VM. In one embodiment, the VM is a Java VM (“JVM”).
[0006] When memory of the internal heap becomes scarce, one or more of the local objects may be garbage collected. Garbage collecting data can be copied into the monitoring memory, as one type of the status data.
[0007] In one embodiment, multiple JVMs may each execute one or more Java applications. Shared objects created during execution of these Java applications may be stored into a shared heap that is maintained external to the multiple JVMs. Shared status data regarding the shared heap may also be copied into the monitoring memory.
[0008] In an embodiment with multiple JVMs, shared classes may be loaded during execution of the Java applications and stored within the shared heap. These shared classes may be used to instantiate the shared objects.
[0009] In one embodiment, the status data stored in the monitoring memory may be retrieved in response to receiving a status query, and the status data transmitted to a monitoring console to display the status data.
[0010] Embodiments of the invention may include all or some of the above described features. The above features can be implemented using a computer program, a method, a system or apparatus, or any combination of computer programs, methods, or systems. These and other details of one or more embodiments of the invention are set forth in the accompanying drawings and in the description below.
Brief Description of the Drawings
[0011] Non-limiting and non-exhaustive embodiments of the invention are described with reference to the following figures, wherein like reference numerals refer to like parts throughout the various views unless otherwise specified.
[0012] FIG. 1 is a block diagram illustrating a software system for monitoring the health of Java worker nodes from a monitoring console, in accordance with an embodiment of the invention.
[0013] FIG. 2 is a block diagram illustrating a software environment of an application server instance implemented with shared monitoring memory for monitoring Java virtual machines, in accordance with an embodiment of the invention.
[0014] FIG. 3 is a flow chart illustrating a process for generating status data for one or more Java virtual machines and storing the status data within shared monitoring memory, in accordance with an embodiment of the invention.
[0015] FIG. 4 is a block diagram illustrating a monitoring console for displaying status data of Java virtual machines communicated from an application server instance, in accordance with an embodiment of the invention.
[0016] FIG. 5 is a flow chart illustrating a process for communicating status data stored within shared monitoring memory to a monitoring console, in accordance with an embodiment of the invention.
[0017] FIG. 6 is a block diagram illustrating a demonstrative enterprise environment for implementing embodiments of the invention.
[0018] FIG. 7 illustrates a demonstrative processing system for implementing embodiments of the invention.
Detailed Description
[0019] Embodiments of a system and method for monitoring java virtual machines (“JVMs”) using shared monitoring memory are described herein. In the following description numerous specific details are set forth to provide a thorough understanding of the embodiments. One skilled in the relevant art will recognize, however, that the techniques described herein can be practiced without one or more of the specific details, or with other methods, components, materials, etc. In other instances, well-known structures, materials, or operations are not shown or described in detail to avoid obscuring certain aspects.
[0020] Reference throughout this specification to “one embodiment” or “an embodiment” means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the invention. Thus, the appearances of the phrases “in one embodiment” or “in an embodiment” in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
[0021] FIG. 1 is a block diagram illustrating a software system 100 for monitoring the health of Java worker nodes 105 from a monitoring console 110, in accordance with an embodiment of the invention. In the illustrated embodiment, software system 100 includes an application server (“AS”) instance 115 and monitoring console 110. AS instance 115 includes one or more Java worker nodes 105 each providing the runtime environment for a Java virtual machine (“JVM”) 120, which in turn interprets/executes Java applications 125. Although the embodiments illustrated herein are described in connection with the Java programming language and JVMs, it should be appreciated that these techniques may be extended to other types of virtual machines and interpreted languages by those of ordinary skill in the art having the benefit of the instant disclosure.
[0022] Collectively, Java applications 125 may provide the logic for implementing various sub-layers (e.g., business layer, integration layer, presentation layer, etc.) of AS instance 115. In one embodiment, AS instance 115 is a web application server, such as Web AS by SAP, .NET by Microsoft, or the like. It should be appreciated that various components of AS instance 115 have been excluded from FIG. 1 for the sake of clarity and so as not to obscure the invention.
[0023] In one embodiment, Java applications 125 include compiled bytecode to be verified and interpreted by JVMs 105. For example, Java applications 125 may be servlets providing server-side logic to generate graphical user interfaces (“GUIs”) on remote clients and may further include JavaServer Page (“JSP”) extensions for providing dynamic content within the GUI. Java applications 125 may include business applications providing the business logic of an Enterprise JavaBean (“EJB”), applets providing client side logic, and the like.
[0024] During execution of Java applications 125, Java worker nodes 105 publish status data 130 to shared monitoring memory 135. Status data 130 includes operational health data of the internal workings of JVMs 120. This operational health data may include statistical data detailing heap utilization, garbage collecting activity, and the like. Once status data 130 is published to shared monitoring memory 135, monitoring console 110 can query shared monitoring memory 135 to display status data 130 for review by an Information Technology (“IT”) technician. Monitoring console 110 may be located locally on the same hardware machine executing AS instance 115, or advantageously, executed on a remote machine coupled to a network. Monitoring console 110 may further monitor an entire cluster of AS instances 115, all from a single remote machine.
[0025] FIG. 2 is a block diagram illustrating a software environment 200 of AS instance 115 implemented with shared monitoring memory 135 for monitoring the internal workings of JVMs 120, in accordance with an embodiment of the invention. The illustrated embodiment of software environment 200 includes native runtime processes 205, shared heap 210, shared monitoring memory 135, web service interface 215, and JVM control unit 220. Each native runtime process 205 provides the runtime environment for a single JVM 120. Together, a native runtime process 205 and a JVM 120 form a Java worker node 105. In a J2EE environment, JVM control unit 220 is often referred to as “JControl.”
[0026] The components of software environment 200 interact as follows. In one embodiment, web service interface 215 is loaded first. Web service interface 215 provides interface capabilities for the components of software environment 200 to communicate across an attached network. In one embodiment, web service interface 215 can be launched remotely from a command console. In a Java 2 Platform, Enterprise Edition (“J2EE”) environment, web service interface 215 is known as the WebService Based Start Service.
[0027] Once loaded and operating, web service interface 215 launches JVM control unit 220. In turn, JVM control unit 220 reserves and allocates memory to establish shared monitoring memory 135. Subsequently, JVM control unit 220 launches each native runtime process 205 to provide the runtime environments for JVMs 120. JVM control unit 220 is responsible for the life cycles of each native runtime process 205. JVM control unit 220 can launch a new native runtime process 205, terminate an existing native runtime process 205 at an end of its useful life cycle, or restart a hung, or otherwise problematic, native runtime process 205.
[0028] In one embodiment, web service interface 215, JVM control unit 220, and native runtime processes 205 are operating system (“OS”) runtime processes managed by the OS runtime environment. In one embodiment, web service interface 215, JVM control unit 220, and native runtime processes 205 are native machine code, such as compiled C++.
[0029] Upon commencement of a new native runtime process 205, the new native runtime process 205 will establish a new JVM 120 therein. During operation, each Java worker node 105 is assigned user requests by a dispatcher (not illustrated), services user sessions, and executes/interprets Java applications 125 on JVMs 120. Each JVM 120 establishes an internal heap 225 as a pre-reserved memory pool for future use by Java applications 125 as they are loaded. Internal heaps 225 are managed by each JVM 120 allocating and deallocating memory as is required by Java applications 125.
[0030] Java applications 125 include objects and classes. Objects and classes that are local or private only to a particular Java worker node 105 and not shared with other Java worker nodes 105 within AS instance 115 are called local classes 230 and local objects 235. When Java applications 125 are loaded and executed by JVM 120, local classes 230 and local objects 235 are stored within internal heaps 225 for use by Java applications 125 running on a single JVM 120. Classes include methods that perform tasks and return information when they complete those tasks. Objects are essentially reusable software components that model pieces of software programs in terms of properties and behaviors. Classes are used to instantiate an object with these properties and behaviors. In other words, local objects 235 inherit their properties and behaviors from the particular local class 230 used to instantiate (e.g., create) the particular local object 235.
[0031] As Java applications 125 consume internal heaps 225 by filling them with local classes 230 and local objects 235, memory within internal heaps 225 available to accept new local classes or new local objects may become scarce. As such, each JVM 120 includes a garbage collector 240 to implement a disciplined procedure for returning consumed resources back to the particular internal heap 225. In one embodiment, garbage collector 240 is a thread automatically executed by JVM 120 to reclaim dynamically allocated memory without explicit instructions to do so by the programmer of Java applications 125. When there are no more references to a local object 235 within internal heap 225, the particular local object 235 is marked for garbage collection. The memory consumed by the marked local object 235 is then reclaimed when garbage collector 240 executes. Performing regular garbage collection when available memory within internal heap 225 becomes scarce helps avoid resource leaks.
[0032] However, when available memory within internal heap 225 becomes scarce, performance of the particular Java worker node 105 suffers due to the garbage collecting activities. In practice, if internal heap 225 exceeds 80% capacity, garbage collecting activities of garbage collector 240 may result in the productive computing output of the particular Java worker node 105 grinding to a near halt. Although garbage collector 240 is relatively good at deleting unreferenced local objects 235 to reclaim consumed memory, not all idle local objects 235 are reclaimed for a variety of reasons. As such, the older a particular Java worker node 105 happens to be, the more likely that Java worker node 105 is to suffer from chronic garbage collecting activity.
[0033] Not all objects utilized by Java applications 125 are local to the particular Java worker node 105. In one embodiment, shared heap 210 stores shared classes 250 and shared objects 255 utilized by Java applications 125 executing on multiple Java worker nodes 105. Shared heap 210 is a memory pool external to JVMs 120 and accessible by Java applications 125 executing on multiple JVMs 120. In this embodiment, the first Java application 125 to instantiate and use a shared object 255, places the new shared object 255 into shared heap 210. Subsequently, other Java worker nodes 105 and Java applications 125 can use the shared object 255 without expensing time and computing resources to create the particular shared object 255. Sharing classes and objects within shared heap 210 not only saves computing time that would otherwise be consumed to create the same object multiple times, it also conserves available memory within internal heaps 225, since a single instance of a shared object 255 can replace multiple instances of the very same local object within multiple internal heaps 225.
[0034] The processes explained below are described in terms of computer software and hardware. The techniques described may constitute machine-executable instructions embodied within a machine (e.g., computer) readable medium, that when executed by a machine will cause the machine to perform the operations described. Additionally, the processes may be embodied within hardware, such as an application specific integrated circuit (“ASIC”) or the like. The order in which some or all of the process blocks appear in each process should not be deemed limiting. Rather, one of ordinary skill in the art having the benefit of the present disclosure will understand that some of the process blocks may be executed in a variety of orders not illustrated.
[0035] FIG. 3 is a flow chart illustrating a process 300 for generating status data 130 for one or more JVMs 120 and storing status data 130 within shared monitoring memory 135, in accordance with an embodiment of the invention. In a process block 305, Java applications 125 cause local classes 230 and shared classes 250 to be loaded into internal heaps 225 and shared heap 210, respectively. In a process block 310, local objects 235 are instantiated with local classes 230 and stored into internal heaps 225, while shared objects 255 are instantiated with shared classes 250 and stored into shared heap 210.
[0036] During operating of Java applications 125, shared monitoring memory 135 is updated with status data 130. Status data 130 may include a variety of information to monitor the internal workings of each JVM 120 in real-time (e.g., heap utilization statistics, garbage collecting statistics, etc.).
[0037] In a process block 315, a virtual machine (“VM”) monitor 260 updates shared monitoring memory 135 with heap utilization data. In the illustrated embodiment, VM monitor 260 is a sub-component of native runtime process 205. As such, in the illustrated embodiment, VM monitor 260 is external to JVM 120 and not executed/interpreted thereon. To gain access to the internal structures of JVM 120, a native application programming interface (“API”) 265 is provided by native runtime process 205. In one embodiment, native API 265 includes functions that can retrieve data from within JVM 120, such as from internal heap 225. VM monitor 260 calls the functions of native API 265, which return the requested data. In one embodiment, the functions may return utilization statistics of internal heap 225 (e.g., “hit rate” of various local objects, number of local objects, amount of internal heap consumed, available memory within internal heap, etc.). In response, VM monitor 260 copies/publishes the heap utilization data into shared monitoring memory 135. In one embodiment, VM monitor 260 may format/organize the heap utilization data prior to publishing it into shared monitoring memory 135. In one embodiment, VM monitor 260 updates shared monitoring memory 135 on a periodic basis (e.g., every 5 seconds or so).
[0038] As discussed above, during execution of Java applications 125, available memory within internal heap 225 may become scarce. If internal heap 225 approaches capacity (decision block 320), then process 300 continues to a process block 325. In process block 325, garbage collector 240 performs automatic garbage collection to delete unreferenced local objects 235 and reclaim the consumed memory within internal heap 225.
[0039] In a process block 330, shared monitoring memory 135 is updated with garbage collecting data in response to the garbage collection event in process block 325. In one embodiment, a callback function of native API 265 updates shared monitoring memory 135 with the garbage collection status data. Whenever a garbage collecting event occurs, JVM 120 invokes the callback function, which in turn makes a note of the garbage collecting event within shared monitoring memory 135. In yet another embodiment, the callback function transfers status data of the garbage collecting event to VM monitor 260, which in turn registers the garbage collecting event into shared monitoring memory 135. A history of garbage collecting events and related monitoring data may be saved concurrently within shared monitoring memory 135.
[0040] As discussed above, shared monitoring memory 135 is external to Java worker nodes 105. As such, shared monitoring memory 135 is insulated from Java worker nodes 105 in the event one or more of them crashes, hangs (e.g., enters an infinite loop), or otherwise fails. Accordingly, even if a JVM 120 crashes, the latest status data 130 just prior to the faulty JVM 120 going down is still available within shared monitoring memory 135. Vital information may be quickly obtained from shared monitoring memory 135 to determine the source of the error. In fact, this postmortem status data may already be displayed on monitoring console 110 for inspection by an IT technician without any additional effort to obtain it.
[0041] FIG. 4 is a block diagram illustrating monitoring console 110 for displaying status data 130 retrieved from JVMs 120, in accordance with an embodiment of the invention. As illustrated, web service interface 215 is communicatively coupled to retrieve status data 130 from shared monitoring memory 135 and transmits this data across a network 305 (or other communication medium) to monitoring console 110. It should be appreciated that monitoring console 110 may execute on the same physical hardware as AS instance 105, in which case status data 130 would not need to be transmitted across network 305.
[0042] FIG. 5 is a flow chart illustrating a process 500 for communicating status data 130 from shared monitoring memory 135 to monitoring console 110, in accordance with an embodiment of the invention. In a process block 505, monitoring console 110 transmits a status query to AS instance 105. The status query may be transmitted to AS instance 105 automatically on a periodic basis, in response to a specified event, or in response to a screen refresh request by an IT technician.
[0043] In the illustrated embodiment, monitoring console 110 can display both garbage collection statistics and heap utilization statistics. The garbage collecting activities of multiple JVMs 120 can be displayed at once. The garbage collecting monitoring data displayed may include a recent history for each JVM 120, while outputting long term records to log files. The garbage collecting monitoring data may include: amount of currently available memory within each internal heap 225, percentage of currently available memory, amount of consumed memory within internal heap 225, percentage of consumed memory within internal heap 225, absolute amount of available memory, start and stop time/date of each garbage collecting event, duration of each garbage collecting event, and the like.
[0044] The heap utilization monitoring data displayed may include: shared class utilization, shared object utilization, local class utilization, and local object utilization for each JVM 120. In one embodiment, the heap utilization data may simply be a snap shot of the most recent utilization statistics or include a recent history of the utilization statistics. The utilization data displayed may include hit rates, number of objects/classes currently residing in each heap, last time each object/class was utilized, and the like. The utilization statistics may also be output to a log file.
[0045] Furthermore, monitoring console 110 may display and monitor multiple AS instances 105 coupled to network 305. In this embodiment, monitoring console 110 may include multiple panels, tabs, or windows associated with each AS instance 105 and output long term records to separate log files for each AS instance 105.
[0046] In a process block 510, web service interface 215 receives the status query and parses shared monitoring memory 135 to retrieve the requested status data. In response, the retrieved status data is transmitted to monitoring console 110 (process block 515) and displayed by monitoring console 110 to a screen for inspection by a user, such as an IT technician or the like (process block 520).
[0047] In one embodiment, web service interface 215 and monitoring console 110 may negotiate a reporting contract dictating that web service interface 215 is to periodically update monitoring console 110 with status data 130 without need of first transmitting the status query (process blocks 505 and 510). In this case, web service interface 215 pushes status data 130 to monitoring console 110, as opposed to monitoring console 110 pulling status data 130 from web service interface 215.
[0048] FIG. 6 is a block diagram illustrating a demonstrative enterprise environment 600 for implementing embodiments of the invention. The illustrated embodiment of enterprise environment 600 includes a cluster 605 coupled to service requests from client nodes 610. Cluster 605 may include one or more server nodes 615 each supporting one or more AS instances 105, a message server node 620 supporting a message server 622, a database node 625 supporting a database 627, and a web dispatcher 630.
[0049] Web dispatcher 630 implements a load-balancing mechanism distributing service requests from client nodes 610 among server nodes 615 within cluster 605. For example, web dispatcher 630 may implement a round-robin load-balancing mechanism or the like. Web dispatcher 630 may be one of server nodes 615 having the task of dispatching service requests among server nodes 615 of cluster 605 or a stand alone hardware node. The service requests are processed by server nodes 615 and subsequently provided to database nodes 625. Database nodes 625 offer up the requested data to server nodes 615, which in turn process and format the results for display on client nodes 610.
[0050] Eash AS instance 105 may further include its own dispatcher mechanism to distribute the requests assigned to it among its individual Java worker nodes 105. In one embodiment, Java worker nodes 105 are based on J2EE. AS instances 105 may further include other types of worker nodes including those based on the Microsoft .NET standard, the Advanced Business Application Programming (“ABAP”) standard developed by SAP AG, and the like.
[0051] One of client nodes 610 may execute monitoring console 110 to provide remote monitoring of AS instances 115, and in particular, remote monitoring of each worker node (including Java worker nodes 105, .NET worker nodes, and ABAP worker nodes). If an IT technician notices that one of the worker nodes has a low heap utilization, overactive garbage collection activity, or the like, the IT technician can take appropriate action including resetting the problematic worker node. Alternatively, scripts may run in concert with monitoring console 110 on a client node 610 to automatically address a problematic worker node based on a predefined response policy.
[0052] FIG. 7 is a block diagram illustrating a demonstrative processing system 700 for executing any of AS instance 115, software environment 200, monitoring console 110, or implementing any of client nodes 610, server nodes 615, message server node 620, or database node 625. The illustrated embodiment of processing system 700 includes one or more processors (or central processing units) 705, system memory 710, nonvolatile (“NV”) memory 715, a DSU 720, a communication link 725, and a chipset 730. The illustrated processing system 700 may represent any computing system including a desktop computer, a notebook computer, a workstation, a handheld computer, a server, a blade server, or the like.
[0053] The elements of processing system 700 are interconnected as follows. Processor(s) 705 is communicatively coupled to system memory 710, NV memory 715, DSU 720, and communication link 725, via chipset 730 to send and to receive instructions or data thereto/therefrom. In one embodiment, NV memory 715 is a flash memory device. In other embodiments, NV memory 715 includes any one of read only memory (“ROM”), programmable ROM, erasable programmable ROM, electrically erasable programmable ROM, or the like. In one embodiment, system memory 710 includes random access memory (“RAM”), such as dynamic RAM (“DRAM”), synchronous DRAM, (“SDRAM”), double data rate SDRAM (“DDR SDRAM”) static RAM (“SRAM”), and the like. DSU 720 represents any storage device for software data, applications, and/or operating systems, but will most typically be a nonvolatile storage device. DSU 720 may optionally include one or more of an integrated drive electronic (“IDE”) hard disk, an enhanced IDE (“EIDE”) hard disk, a redundant array of independent disks (“RAID”), a small computer system interface (“SCSI”) hard disk, and the like. Although DSU 720 is illustrated as internal to processing system 700, DSU 720 may be externally coupled to processing system 700. Communication link 725 may couple processing system 700 to a network (e.g., network 305) such that processing system 700 may communicate over the network with one or more other computers. Communication link 725 may include a modem, an Ethernet card, a Gigabit Ethernet card, Universal Serial Bus (“USB”) port, a wireless network interface card, a fiber optic interface, or the like.
[0054] It should be appreciated that various other elements of processing system 700 have been excluded from FIG. 7 and this discussion for the purposes of clarity. For example, processing system 700 may further include a graphics card, additional DSUs, other persistent data storage devices (e.g., tape drive), and the like. Chipset 730 may also include a system bus and various other data buses for interconnecting subcomponents, such as a memory controller hub and an input/output (“I/O”) controller hub, as well as, include data buses (e.g., peripheral component interconnect bus) for connecting peripheral devices to chipset 730. Correspondingly, processing system 700 may operate without one or more of the elements illustrated. For example, processing system 700 need not include DSU 720.
[0055] The above description of illustrated embodiments of the invention, including what is described in the Abstract, is not intended to be exhaustive or to limit the invention to the precise forms disclosed. While specific embodiments of, and examples for, the invention are described herein for illustrative purposes, various equivalent modifications are possible within the scope of the invention, as those skilled in the relevant art will recognize.
[0056] These modifications can be made to the invention in light of the above detailed description. The terms used in the following claims should not be construed to limit the invention to the specific embodiments disclosed in the specification and the claims. Rather, the scope of the invention is to be determined entirely by the following claims, which are to be construed in accordance with established doctrines of claim interpretation.
Claims
What is claimed is:
1. A computer-implemented method, comprising:
implementing at a server node in a network of nodes an application server instance having a virtual machine control unit;
launching with the virtual machine control unit at least two worker nodes within the application server instance, each of the at least two worker nodes providing a respective run-time environment;
in each of the respective run-time environments of the at least two worker nodes,
executing a respective virtual machine (“VM”) and a respective virtual machine monitor for the respective VM, and
running by the respective VM a respective application , including storing a local object within a respective heap internal to and maintained by the VM;
one of the virtual machines (“VMs”) instantiating a data object in a shared heap of the application server instance external to the at least two worker nodes and accessible by the VMs of the at least two worker nodes; and
publishing status data to a monitoring memory of the application server instance external to and shared by the at least two worker nodes and the shared heap, wherein the monitoring memory is accessible to a monitoring console configured to display the published status data, the published status data including
data specifying a utilization of the shared heap, and
for each of the plurality of worker nodes,
data specifying a utilization of the internal heap of the respective VM, and
data specifying a history of garbage collecting events of the internal heap of the respective VM.
2. The method of claim 1, wherein the respective VMs of the at least two worker nodes comprise a Java VM (“JVM”) and wherein the application run by the JVM includes a Java application.
3. The method of claim 1, wherein publishing the status data comprises:
accessing an internal heap through a native application programming interface (“API”);
retrieving the status data of the accessed internal heap by a VM monitor executed within the respective worker node of the accessed internal heap; and
copying the status data retrieved by the VM monitor to the monitoring memory.
4. The method of claim 3, wherein one of the VM monitors of the at least two worker nodes comprises native machine code.
5. The method of claim 2, further comprising:
garbage collecting at least one of the local objects maintained within the internal heap of the JVM when available memory of the internal heap is scarce; and
registering the garbage collecting with the monitoring memory.
6. The method of claim 1, wherein the shared status data includes at least one of shared object utilization data, shared class utilization data, and shared heap garbage collecting activity.
7. The method of claim 1, further comprising:
retrieving the status data from the monitoring memory; and
transmitting the status data to the monitoring console to display the status data.
8. The method of claim 1, wherein the monitoring memory is isolated from the respective VMs of the at least two worker nodes to provide acccss to the status data published to the monitoring memory in the event one of the VMs fails.
9. A computer-readable storage medium having stored thereon instructions that, if executed by a machine, will cause the machine to perform operations comprising:
implementing at a server node in a network of nodes an application server instance having a virtual machine control unit;
launching with the virtual machine control unit at least two worker nodes within the application server instance, each of the at least two worker nodes providing a respective run-time environment;
in each of the respective run-time environments of the at least two worker nodes,
executing a respective java virtual machine (“JVM”) and a respective virtual machine monitor for the respective JVM, and
running by the respective JVM a respective application , including storing local objects within a corresponding internal heap internal to and maintained by the corresponding JVM;
one of the java virtual machines (“JVMs”) instantiating a data object in a shared heap of the application server instance external to the at least two worker nodes and accessible by the JVMs of the at least two worker nodes; and
publishing status data to a monitoring memory of the application server instance external to and shared by the at least two worker nodes and the shared heap, wherein the monitoring memory is accessible to a monitoring console configured to display the published status data, the published status data including
data specifying a utilization of the shared heap, and
for each of the plurality of worker nodes,
data specifying a utilization of the internal heap of the respective JVM, and
data specifying a history of garbage collecting events of the internal heap of the respective JVM.
10. The computer-readable storage medium of claim 9, wherein publishing the status data comprises:
accessing an internal heap through a native application programming interface (“API”);
retrieving status data of the accessed internal heap by a VM monitor executed within the respective worker node of the accessed internal heap; and
copying the status data retrieved by the VM monitor to the shared monitoring memory.
11. The computer-readable storage medium of claim 9, further providing instructions that, if executed by the machine, will cause the machine to perform further operations, comprising:
garbage collecting at least one of the local objects maintained within the internal heap of one of the plurality of JVMs when available memory of the internal heap is scarce; and
in response to the garbage collecting, publishing garbage collecting monitoring data to the shared monitoring memory.
12. The computer-readable storage medium of claim 9, wherein the status data comprises at least one of shared object utilization data, shared class utilization data, and shared heap garbage collecting data.
13. A system, comprising:
a server node to execute an application server (“AS”) instance, the AS instance including logic executable by a processor of the server node to:
launch with a virtual machine control unit at least two worker nodes within the AS instance, each of the at least two worker nodes providing a run-time environment;
in each of the respective run-time enviromnents of the at least two worker nodes,
execute a respective java virtual machine (“JVM”) and a respective virtual machine monitor for the respective JVM, and
run by the respective JVM a respective application, including storing local objects within a corresponding internal heap internal to and maintained by the corresponding JVM;
instantiate with one of the java virtual machines (“JVMs”) a data object in a shared heap of the AS instance external to the at least two worker nodes and accessible by the JVMs of the at least two worker nodes; and
publish status data to a monitoring memory of the application server instance external to and shared by the at least two worker nodes and the shared heap, wherein the monitoring memory is accessible to a monitoring console configured to display the published status data, the published status data including
data specifying a utilization of the shared heap, and
for each of the plurality of worker nodes,
data specifying a utilization of the internal heap of the respective JVM, and
data specifying a history of garbage collecting events of the internal heap of the respective JVM.
14. The system of claim 13, wherein the logic is further to:
garbage collect at least one of the local objects maintained within the internal heap of one of the plurality of JVMs when available memory of the internal heap is scarce; and
wherein the publishing the status data to the shared monitoring memory is in response to the garbage collecting event.
15. The system of claim 14, further comprising:
a client node to execute the monitoring console, the client node communicatively coupled to the server node, the monitoring console including logic executable by a processor of the client node to:
receive the status data from the server node; and
display the status data to a screen of the client node.
16. The system of claim 15, wherein the monitoring console further includes logic executable by the processor of the client node to monitor a cluster of AS instances.
Patent Citations (157)
| Patent | Date | Inventor | Cited By |
|---|---|---|---|
| US5331318(A) | 1994-07-01 | Montgomery | Applicant |
| US5553242(A) | 1996-09-01 | Russell et al. | Applicant |
| US5566302(A) | 1996-10-01 | Khalidi et al. | Applicant |
| US5566315(A) | 1996-10-01 | Milillo et al. | Applicant |
| US5617570(A) | 1997-04-01 | Russell et al. | Applicant |
| US5682328(A) | 1997-10-01 | Roeber et al. | Applicant |
| US5692193(A) | 1997-11-01 | Jagannathan et al. | Applicant |
| US5710909(A) | 1998-01-01 | Brown et al. | Applicant |
| US5745778(A) | 1998-04-01 | Alfieri | Applicant |
| US5905868(A) | 1999-05-01 | Baghai et al. | Applicant |
| US5909540(A) | 1999-06-01 | Carter et al. | Examiner |
| US5926834(A) | 1999-07-01 | Carlson et al. | Applicant |
| US5944781(A) | 1999-08-01 | Murray | Applicant |
| US5951643(A) | 1999-09-01 | Shelton et al. | Applicant |
| US5961584(A) | 1999-10-01 | Wolf | Applicant |
| US5974566(A) | 1999-10-01 | Ault et al. | Applicant |
| US6038571(A) | 2000-03-01 | Numajiri et al. | Applicant |
| US6065006(A) | 2000-05-01 | deCarmo et al. | Applicant |
| US6092171(A) | 2000-07-01 | Relph | Applicant |
| US6115712(A) | 2000-09-01 | Islam et al. | Applicant |
| US6115721(A) | 2000-09-01 | Nagy | Applicant |
| US6167449(A) | 2000-12-01 | Arnold et al. | Applicant |
| US6199179(B1) | 2001-03-01 | Kauffman et al. | Applicant |
| US6216212(B1) | 2001-04-01 | Challenger et al. | Applicant |
| US6256712(B1) | 2001-07-01 | Challenger et al. | Applicant |
| US6272598(B1) | 2001-08-01 | Arlitt et al. | Applicant |
| US6295582(B1) | 2001-09-01 | Spencer | Applicant |
| US6330709(B1) | 2001-12-01 | Maynard et al. | Applicant |
| US6336170(B1) | 2002-01-01 | Dean et al. | Applicant |
| US6349344(B1) | 2002-02-01 | Sauntry et al. | Applicant |
| US6356529(B1) | 2002-03-01 | Zarom | Applicant |
| US6356946(B1) | 2002-03-01 | Clegg et al. | Applicant |
| US6385643(B1) | 2002-05-01 | Jacobs et al. | Applicant |
| US6412045(B1) | 2002-06-01 | DeKoning et al. | Applicant |
| US6415364(B1) | 2002-07-01 | Bauman et al. | Applicant |
| US6438560(B1) | 2002-08-01 | Loen | Examiner |
| US6438654(B1) | 2002-08-01 | Elko et al. | Applicant |
| US6467052(B1) | 2002-10-01 | Kaler et al. | Applicant |
| US6519594(B1) | 2003-02-01 | Li | Applicant |
| US6587937(B1) | 2003-07-01 | Jensen et al. | Applicant |
| US6591347(B2) | 2003-07-01 | Tischler et al. | Applicant |
| US6615253(B1) | 2003-09-01 | Bowman-Amuah | Applicant |
| US6640244(B1) | 2003-10-01 | Bowman-Amuah | Applicant |
| US6651080(B1) | 2003-11-01 | Liang et al. | Applicant |
| US6687702(B2) | 2004-02-01 | Vaitheeswaran et al. | Applicant |
| US6738977(B1) | 2004-05-01 | Berry et al. | Applicant |
| US6760911(B1) | 2004-07-01 | Ye | Applicant |
| US6766419(B1) | 2004-07-01 | Zahir et al. | Applicant |
| US6769022(B1) | 2004-07-01 | DeKoning et al. | Applicant |
| US6772409(B1) | 2004-08-01 | Chawla et al. | Applicant |
| US6795856(B1) | 2004-09-01 | Bunch | Applicant |
| US6879995(B1) | 2005-04-01 | Chinta et al. | Applicant |
| US6970925(B1) | 2005-11-01 | Springmeyer et al. | Applicant |
| US7003770(B1) | 2006-02-01 | Pang et al. | Applicant |
| US7024512(B1) | 2006-04-01 | Franaszek et al. | Applicant |
| US7089566(B1) | 2006-08-01 | Johnson | Applicant |
| US7111300(B1) | 2006-09-01 | Salas et al. | Applicant |
| US7124170(B1) | 2006-10-01 | Sibert | Examiner |
| US7127472(B1) | 2006-10-01 | Enokida et al. | Applicant |
| US7149741(B2) | 2006-12-01 | Burkey et al. | Applicant |
| US7155512(B2) | 2006-12-01 | Lean et al. | Applicant |
| US7165239(B2) | 2007-01-01 | Hejlsberg et al. | Applicant |
| US7191170(B2) | 2007-03-01 | Ganguly et al. | Applicant |
| US7194761(B1) | 2007-03-01 | Champagne | Applicant |
| US7237140(B2) | 2007-06-01 | Nakamura et al. | Examiner |
| US7246167(B2) | 2007-07-01 | Kalmuk et al. | Applicant |
| US7296267(B2) | 2007-11-01 | Cota-Robles et al. | Applicant |
| US7302423(B2) | 2007-11-01 | De Bellis | Applicant |
| US7418560(B2) | 2008-08-01 | Wintergerst | Applicant |
| US2001/0029520(A1) | 2001-10-01 | Miyazaki et al. | Applicant |
| US2002/0046325(A1) | 2002-04-01 | Cai et al. | Applicant |
| US2002/0052914(A1) | 2002-05-01 | Zalewski et al. | Applicant |
| US2002/0073283(A1) | 2002-06-01 | Lewis et al. | Applicant |
| US2002/0078060(A1) | 2002-06-01 | Garst et al. | Applicant |
| US2002/0083118(A1) | 2002-06-01 | Sim | Applicant |
| US2002/0083166(A1) | 2002-06-01 | Dugan et al. | Applicant |
| US2002/0093487(A1) | 2002-07-01 | Rosenberg | Applicant |
| US2002/0147888(A1) | 2002-10-01 | Trevathan | Applicant |
| US2002/0169926(A1) | 2002-11-01 | Pinckney et al. | Applicant |
| US2002/0174097(A1) | 2002-11-01 | Rusch et al. | Applicant |
| US2002/0181307(A1) | 2002-12-01 | Fifield et al. | Applicant |
| US2003/0009533(A1) | 2003-01-01 | Shuster | Applicant |
| US2003/0014521(A1) | 2003-01-01 | Elson et al. | Applicant |
| US2003/0014552(A1) | 2003-01-01 | Vaitheeswaran et al. | Applicant |
| US2003/0023827(A1) | 2003-01-01 | Palanca et al. | Applicant |
| US2003/0028671(A1) | 2003-02-01 | Mehta et al. | Applicant |
| US2003/0037178(A1) | 2003-02-01 | Vessey et al. | Applicant |
| US2003/0084248(A1) | 2003-05-01 | Gaither et al. | Applicant |
| US2003/0084251(A1) | 2003-05-01 | Gaither et al. | Applicant |
| US2003/0088604(A1) | 2003-05-01 | Kuck et al. | Applicant |
| US2003/0093420(A1) | 2003-05-01 | Ramme | Applicant |
| US2003/0093487(A1) | 2003-05-01 | Czajkowski et al. | Applicant |
| US2003/0097360(A1) | 2003-05-01 | McGuire et al. | Applicant |
| US2003/0105887(A1) | 2003-06-01 | Cox et al. | Applicant |
| US2003/0115190(A1) | 2003-06-01 | Soderstrom et al. | Applicant |
| US2003/0131010(A1) | 2003-07-01 | Redpath | Applicant |
| US2003/0131286(A1) | 2003-07-01 | Kaler et al. | Applicant |
| US2003/0177382(A1) | 2003-09-01 | Ofek et al. | Applicant |
| US2003/0191795(A1) | 2003-10-01 | Bernardin et al. | Applicant |
| US2003/0196136(A1) | 2003-10-01 | Haynes et al. | Applicant |
| US2003/0208563(A1) | 2003-11-01 | Acree et al. | Applicant |
| US2003/0212654(A1) | 2003-11-01 | Harper et al. | Applicant |
| US2003/0229760(A1) | 2003-12-01 | Doyle et al. | Applicant |
| US2004/0024610(A1) | 2004-02-01 | Fradkov et al. | Applicant |
| US2004/0024881(A1) | 2004-02-01 | Elving et al. | Applicant |
| US2004/0024971(A1) | 2004-02-01 | Bogin et al. | Applicant |
| US2004/0045014(A1) | 2004-03-01 | Radhakrishnan | Applicant |
| US2004/0117441(A1) | 2004-06-01 | Liu et al. | Applicant |
| US2004/0128370(A1) | 2004-07-01 | Kortright | Applicant |
| US2004/0168029(A1) | 2004-08-01 | Civlin | Applicant |
| US2004/0181537(A1) | 2004-09-01 | Chawla et al. | Applicant |
| US2004/0187140(A1) | 2004-09-01 | Aigner et al. | Applicant |
| US2004/0205299(A1) | 2004-10-01 | Bearden | Applicant |
| US2004/0215703(A1) | 2004-10-01 | Song et al. | Applicant |
| US2004/0215883(A1) | 2004-10-01 | Bamford et al. | Applicant |
| US2005/0021917(A1) | 2005-01-01 | Mathur et al. | Applicant |
| US2005/0027943(A1) | 2005-02-01 | Steere et al. | Applicant |
| US2005/0044301(A1) | 2005-02-01 | Vasilevsky et al. | Applicant |
| US2005/0055686(A1) | 2005-03-01 | Buban et al. | Applicant |
| US2005/0060704(A1) | 2005-03-01 | Bulson et al. | Applicant |
| US2005/0071459(A1) | 2005-03-01 | Costa-Requena et al. | Applicant |
| US2005/0086656(A1) | 2005-04-01 | Whitlock et al. | Applicant |
| US2005/0086662(A1) | 2005-04-01 | Monnie et al. | Applicant |
| US2005/0125503(A1) | 2005-06-01 | Iyengar et al. | Applicant |
| US2005/0138193(A1) | 2005-06-01 | Encarnacion et al. | Applicant |
| US2005/0160396(A1) | 2005-07-01 | Chadzynski | Applicant |
| US2005/0180429(A1) | 2005-08-01 | Ghahremani et al. | Applicant |
| US2005/0198199(A1) | 2005-09-01 | Dowling | Applicant |
| US2005/0216502(A1) | 2005-09-01 | Kaura et al. | Applicant |
| US2005/0262181(A1) | 2005-11-01 | Schmidt et al. | Applicant |
| US2005/0262512(A1) | 2005-11-01 | Schmidt et al. | Applicant |
| US2005/0268294(A1) | 2005-12-01 | Petev et al. | Applicant |
| US2005/0278274(A1) | 2005-12-01 | Kovachka-Dimitrova et al. | Applicant |
| US2005/0278346(A1) | 2005-12-01 | Shang et al. | Applicant |
| US2006/0053112(A1) | 2006-03-01 | Chitkara et al. | Applicant |
| US2006/0059453(A1) | 2006-03-01 | Kuck et al. | Applicant |
| US2006/0064545(A1) | 2006-03-01 | Wintergerst | Applicant |
| US2006/0064549(A1) | 2006-03-01 | Wintergerst | Applicant |
| US2006/0070051(A1) | 2006-03-01 | Kuck et al. | Applicant |
| US2006/0092165(A1) | 2006-05-01 | Abdalla et al. | Applicant |
| US2006/0094351(A1) | 2006-05-01 | Nowak et al. | Applicant |
| US2006/0143389(A1) | 2006-06-01 | Kilian et al. | Applicant |
| US2006/0143392(A1) | 2006-06-01 | Petev et al. | Applicant |
| US2006/0150197(A1) | 2006-07-01 | Werner | Applicant |
| US2006/0159197(A1) | 2006-07-01 | Kraut et al. | Applicant |
| US2006/0167980(A1) | 2006-07-01 | Werner | Applicant |
| US2006/0168646(A1) | 2006-07-01 | Werner | Applicant |
| US2006/0168846(A1) | 2006-08-01 | Juan | Applicant |
| US2006/0206856(A1) | 2006-09-01 | Breeden et al. | Applicant |
| US2006/0253558(A1) | 2006-11-01 | Acree et al. | Applicant |
| US2006/0294253(A1) | 2006-12-01 | Linderman | Applicant |
| US2007/0050768(A1) | 2007-03-01 | Brown et al. | Applicant |
| US2007/0266305(A1) | 2007-11-01 | Cong et al. | Applicant |
| EP459931 | 1991-12-01 | Applicant | |
| GB2365553 | 2002-02-01 | Applicant | |
| WO-00/23898 | 2000-04-01 | Applicant | |
| WO-03/073204 | 2003-09-01 | Applicant |
Non-Patent Literature (104)
- “OA Mailed Jan. 7, 2008 for U.S. Appl. No. 11/013,277”, filed Jan 7, 2008, Whole Document.Applicant
- “OA Mailed Mar. 12, 2007 for U.S. Appl. No. 11/013,277”, filed Mar. 12, 2007, Whole Document.Applicant
- “FOA Mailed Aug. 17, 2007 for U.S. Appl. No. 11/013,278”, filed Aug. 17, 2007, Whole Document.Applicant
- “OA Mailed Feb. 5, 2008 for U.S. Appl. No. 11/013,278”, filed Feb. 5, 2008, Whole Document.Applicant
- “OA Mailed Mar. 16, 2007 for U.S. Appl. No. 11/013,278”, filed Mar. 16, 2007 , Whole Document.Applicant
- “FOA Mailed Aug. 28, 2007 for U.S. Appl. No. 11/012,803”, filed Aug. 28, 2007, Whole Document.Applicant
- “OA Mailed Jan. 24, 2008 for U.S. Appl. No. 11/012,803”, filed Jan. 24, 2008, Whole Document.Applicant
- “OA Mailed Mar. 16, 2007 for U.S. Appl. No. 11/012,803”, filed Mar. 16, 2007, Whole Document.Applicant
- “OA Mailed Jan. 24, 2008 for U.S. Appl. No. 11/024,393”, filed Jan. 24, 2008, Whole Document.Applicant
- “OA Mailed Feb. 21, 2008 for U.S. Appl. No. 11/027,812”, filed Feb. 21, 2008, Whole Documents.Applicant
- “OA Mailed Apr. 4, 2008 For U.S. Appl. No. 11/118,259”, filed Apr. 4, 2008, Whole Document.Applicant
- “OA Mailed Jun. 11, 2007 for U.S. Appl. No. 11/118,259”, filed Jun. 11, 2007 , Whole Document.Applicant
- USPTO, “OA Mailed Jun. 27, 2008 for U.S. Appl. No. 11/024,391”, filed Jun. 27, 2008, Whole Document.Applicant
- USPTO, “OA Mailed Apr. 4,2008 for U.S. Appl. No. 11/024,392”, filed Apr. 4,2008, Whole Document.Applicant
- “EP 05027361, European Search Report”, (Mar. 28, 2006), Whole Document.Applicant
- “Failover for Clustered RMI-P4 Remote Objects”, SAP Library, http://help.sap.com/saphelp—nw04/helpdata/en/f6/4ef11ab3a52f408aa8a133f33d6cf1/cont, (Nov. 2004), 1-3.Applicant
- “Failover for Enterprise Beans”, SAP Library, http://help.sap.com/saphelp—nw04/helpdata/en/8f/d6e45953a494499ea1b79ab16321d2/cont, (Nov. 2004), 1-3.Applicant
- “Failover System”, SAP Library, http://help.sap.com/saphelp—nw04/helpdata/en/d7/57af0cce55143be5de3a6e4911186.cont, (Nov. 2004), 2.Applicant
- “SAP Beefs Up Java Support Capabilities For New NetWeaver”, News Story, (Computerworld). http:www.computerworld.com/printthis/2004/0,4814,96558,00.html, (Oct. 11,2004), 1-2.Applicant
- “Shared disk I/O cache”, IP.COM Journal, IP.COM Inc., West Henrietta, XP013014199 ISSN: 1533-0001, (Jan. 29, 2004), 6.Applicant
- “System and Method for Shared Memory/File System Java ObjectGroup Clustered JVM”, http://www.priorartdatabase.com/IPCOM/000021597/, (Jan. 2004), 3.Applicant
- Bryce, Ciaran, “Isolates: A New Approach to Multi-Programming in Java Platforms”, LogOn Technology Transfer, Kronerg, Germany, Experts' Corner, (May 2004), 7.Applicant
- Dandamudi, S. P., “Reducing Run Queue Contention in Shared Memory Multipocessors”, Dandamudi, S.P., “Reducing Run Queue Contention in Shared Memory Multipocessors,” IEEE pp. 82-89 (1997) XP000657329., (1997), 82-89.Applicant
- Dillenberger, D., et al., “Building a java Virtual Machine For Serve Applications: The Jvm On Os/390”, IBM Systems Journal, vol. 39, No. 1, (2000), 194-210.Applicant
- Ferguson, Renee B., “SAP Preps New NetWeaver Capabilities”, eWeek.com, http://www.eweek.com/article2/0,1759,1668146,00.asp, (Oct. 7, 2004), 1-6.Applicant
- Jagannathan, et al., “High-Level Abstraction for Efficient Concurrent Systems”, NEC Research Institute, Section 5.2, (Mar. 1994), 20., Section 5.2, (Mar. 1994), 20.Applicant
- Jordan, Mick , et al., “Scaling J2EE Application Servers with the Multi-Tasking Virtual Machine”, Paper, Sun Microsystems, SMLI TR-2004-135, Jun. 2004, pp. 1-19, Paper, Sun Microsystems, SMLI TR-2004-135, (Jun. 2004), 1-19.Applicant
- Kuck, Norbert , et al., “SAP VM Container: Using Process Attachable Virtual machines to Provide Isolation and Scalability For Large Servers”, Article, SAP AG, Walldorf, Germany, (2002), 1-2.Applicant
- Loosco, Marcelo , et al., “A New Distributed Java Virtual Machine for Cluster Computing”, Notes in Computer Science, Springer-Verlag, v. 2790, (2003), 1207-1215.Applicant
- Parnas, Dagfinn , “SAP Virtual Machine Container”, https://weblogs.sdn.sap.com/pub/wlg/940, (Oct. 23, 2004), 1-4.Applicant
- Penchikala, Srini , “J2EE Object-Caching Frameworks”, http://www.javaworld.com/javaworld/jw-05-2004/jw-0531-cache—p.html, (May 31, 2004), Whole Document.Applicant
- Petev, Petio G., et al., “First in First Out Eviction Implementation”, 6570P255 U.S. Appl. No. 11/024,546, filed Dec. 28, 2004, The Office Action mailed Apr. 6, 2007, claims as they stood in the application prior to the mailing of the Office Action an cl, (Dec. 28, 2004), Whole Document.Applicant
- Smits, Thomas , “Unbreakable Java -The Java Server that Never Goes Down”, Article, SAP TechED, Nov. 2004, San Diego and Munich, (Nov. 2004), 1-5.Applicant
- Tanenbaum, A. S., “Multimedia Operating Systems”, Tanenbaum, A.S., Modern Operating Systems, 2nd Edition, Upper Saddle River, New Jersey: Prentice-Hall, Inc., pp. 531-578 (2001). English Translation of: Moderne Betriebssyteme, vol. 2, pp. 539-617, (2002) XP002385695., (2002), 539-617.Applicant
- Werner, Randolf , “Connection of Clients for Management of Systems”, U.S. Appl. No. 11/026,604 filed Dec. 30, 2004.Applicant
- Werner, Randolf , “Interface for External System Management”, U.S. Appl. No. 11/027,812, filed Dec. 29, 2004.Applicant
- Werner, Randolf , “Security for External System Management”, U.S. Appl. No. 11/026,323, filed Dec. 29, 2004.Applicant
- Wintergerst, Michael , et al., “Programming Models for Eviction Policies”, U.S. Appl. No. 11/025,178, filed Dec. 28, 2004, The Office Action mailed Feb. 1, 2007, claims as they stood in the application prior to the mailing of the Office Action, (Dec. 28, 2004), Whole Document.Applicant
- Yue, K. K., et al., “An Effective Processor Allocation Strategy for Multiprogrammed Shared-Memory Multiprocessors”, Yue, K.K. and Lilja, D.J., “An Effective Processor Allocation Strategy for Multiprogrammed Shared-Memory Multiprocessors,” IEEE 8(12):1246-1258, (1997)., (1997), 1246-1258.Applicant
- White Paper: ‘Using Rules-based Object Caching’, spiritsoft / spiritcache 4.0 2004, (2004), 8.Applicant
- ““Desing Overview””, 2003 Sun Micosystems, http://java.sun.com.j2se/1.5.0/docs/guied/jni/spec/design/html, retrieved on Jan. 18, 2008.Applicant
- “All Classes”, http://www.jdocs.com/osche/2.0.2/api/com/opensymphony/oscache/base/allclases-frame.html, (Jan. 2004), 1.Applicant
- “Class AbstractCacheAdministrator”, http://www.jdocs.com/osche/2.0.2/api/com opensymphony/oscache/base/AbstractCache.html, (Jan. 2004), 1-11.Applicant
- “Class Cache”, http://www.jdocs.com/osche/2.0.2/api/com/opensymphony/oscache/base/Cache.html, (Jan. 2004), 1-6.Applicant
- “Class CacheEntry”, http://www.jdocs.com/osche/2.0.2/api/com opensymphony/oscache/base/CacheEntry.html, (Jan. 2004), 1-8.Applicant
- “Class Config”, http://www.jdocs.com/osche/2.0.2/api/com/opensymphony/oscache/base/Config.html, (Jan. 2004), 1-4.Applicant
- “High Availability and Failover”, SAP Library, http://help.sap.com/saphelp—nw04/helpdata/en/6c/209da105668c45be12f1d9cc412e2b/cont, (Nov. 2004), 1-2.Applicant
- “Http Sessions and Failover of Web Application”, SAP Library, http://help.sap.com/saphelp—nw04/helpdata/en/90/044c585eaba42b649f16181b0fdf/cont., (Nov. 2004), 1.Applicant
- “Introducing Cache-Forward Architecture”, ObjectStore, paper, (Jan. 1, 2004), 1-23.Applicant
- “Java Technology in SAP Web Application Server”, SAP Library, http://help.sap.com/saphelp—nw04/helpdata/en/0d/a3bbeff62847ae10000000a114084/cont, (Nov. 2004), 1-3.Applicant
- “Java VineetB-log.java”, http://homepage.mac.com/vineetb/iblog/C684524823/, (Dec. 18, 2003), 1.Applicant
- “JCS Plugin Overview”, http://jakarta.apache.org/jcs/Plugins.html, (Jun. 2004), 2.Applicant
- “JSR 107: JCACHE-Java Temporary Caching API”, http://.jcp.org/en/jsr/detail!id=107, (Mar. 20, 2001), 5.Applicant
- “Load Balancing of the SAP Web As for Java Applications”, SAP Library, http://help.sap.com/saphelp—nw04/helpdata/en/b5/e8239ef7bd494f896a84625d4b688f/cont., (Nov. 2004), 2.Applicant
- “Managers—Intro”, http://db.apache.org/torque-32/managers-cache.html, (Apr. 11, 2002), 1-4.Applicant
- “Open Source Cache Solutions in Java”, http://java-source.net/open-source/cache-solutions, (Nov. 2004), 1-3.Applicant
- “OSCache”, http://www.opensymphony.com/oscache, (Nov. 2004), 1.Applicant
- “OSCache, V 2.0.2 API Specification”, http://www.jdocs.com/osche/2.0.2/api/com/opensymphony/oscache/base/overview-sum.html, (Jan. 2004), 2.Applicant
- “SAP NetWever Makes Standard Java Robust”, http://www.sap.com/company/press/press.epx?pageview=print&pressid=3069, (Oct. 5, 2004), 1-2.Applicant
- “SAP Presents New Capabilities for Netweaver”, InfoWorld, http://www.infoworld.com/article/04/10/06/HNsapnetweaver—1.html, (Oct. 6, 2004), 1-5.Applicant
- “spiritcache”, http://www.spirit-soft.com/index.do?id=30, (Nov. 2004), 1.Applicant
- “turbine-jcs-dev”, http://www.mail-archive.com/[email protected]/msg00647.html, (Jul. 13, 2004), 1-3.Applicant
- “WebLogic RMI Features and Guidelines”, eDocs, http://e-docs.bea.com/wls/docs90/rmi/rmi—api.html, (Nov. 2004), 1-7.Applicant
- “What is LDAP?”, http://www.gracion.com/server/whatldap.html, (Dec. 7, 2004).Applicant
- Barrett, Ryan , “P4 Protocol Specification”, (Sep. 2001), 1-12.Applicant
- Bortvedt, Jerry , “Functional Specification for Object Caching Service for Java (OCS4J), 2.0”, (Aug. 9, 2000), pp. 1-27.Applicant
- Casavant, T. L., et al., ““A Taxonomy of Scheduling in General-Purpose Distributed Computing Systems””, Casavant, T.L., and Kuhl, J.G., “A Taxonomy of Scheduling in General-Purpose Distributed Computing Systems,” IEEE 14(2):141-154, (1988) XP000039761., (1988), 141-154.Applicant
- Conte, Thomas , “Implementing OSCache”, http://www.pas.net/tom/articles/oscache/en/, (Jun. 2002), 1-4.Applicant
- Czajkowski, Grzegorz , et al., “A Multi-User Virtual Machine”, Paper, Sun Microsystems Laboratories and S3 Lab, Purdue University, West Lafayette, IN, (2003), 14.Applicant
- Czajkowski, Grzegorz , “Multitasking without Compromise: A Virtual Machine Evolution”, Paper, Sun Microsystems Laboratories, (2001), 1-14.Applicant
- Davies, Robert , “Data Caching: A Prerequisite to the Enterprise Service Bus”, Business Integration Journal, (Oct. 2003), 41-44.Applicant
- Doyle, Patrick , et al., “A Modular and Extensible JVM Infrastructure”, Paper, Edward S. Rogers Sr. Department of Electrical and Computer Engineering, University of Toronto, Toronto, Ontario, Canada, (Jul. 2002), 14.Applicant
- Gontmakher, Alex , et al., “Characterizations for Java Memory Behavior”, Paper, Computer Science Department, Technion, (1997), 5.Applicant
- Handy, Jim , “The Cache Memory Book”, 1998, Academic Press Inc, 2nd Edition, pp. 60, (1998), vii-229.Applicant
- Hennessy, John , et al., “Computer Organization and Design ”, Morgan Kaufmann Publishers Inc., 2nd Edition, (1998), 575-576.Applicant
- Jordan, Mick , et al., “Extending a J2EE Server with Dynamic and Flexible Resource Management”, Paper, Sun Microsystems, Inc, and School of Computer Science, University of Waterloo, Waterloo, ON, Canada, (Oct. 2004), 20.Applicant
- Luck, Greg , “Ehcache 1.0 released”, http://www.theserverside.com/news, (Oct. 9, 2004), 1-5.Applicant
- March, Andres , “OSCache: Change Log”, http://www.opensymphony.com/oscache/wiki/Change%20Log.html, (Jan. 18, 2004), 1-11.Applicant
- Marinescu, Floyd , “SpiritSoft Announces Availability of SpiritCache 2.0”, http://www.theserverside.com/news/thread.tss?thread—id=18483, (Mar. 21, 2003), 1-5.Applicant
- Movva, Sudhir , et al., “Transparent Clustered Database Failover Using JAVA”, http://www.quest-pipelines.com/newsletter-v5/0604—A.html, (Apr. 2004), 11.Applicant
- Oetiker, Tobias , “SEPP Software Installation and Sharing System”, Proccedings of the Twelfth Systems Administration Conference (LISA '98), Boston, Massachusetts, (Dec. 6-11, 1998), pp. 253-260.Applicant
- Pasin, Marcia , et al., “High-Available Enterprise JavaBeans Using Group Communication System Support”, Pasin et al., “High-Available Enterprise JavaBeans Using Group Communication System Support”, pp. 1-6, XP002285985., 1-6.Applicant
- Penchikala, Srini, “Object Caching in a Web Portal Application Using JCS”, http://www.onjava.com/pub/a/onjava/2003/caching.html, (Dec. 23, 2003), 1-18.Applicant
- Salo, Timo , et al., “Object Persistence Beyond Serialization”, Increasing Productivity and Reducing Maintenance, Dr. Dobb's Journal, M7T Publ., vol. 24, No. 5, XP000925486. ISSN: 1044-789X., (May 1999), 5.Applicant
- Salo, Timo , et al., “Persistence in Enterprise JavaBeans Applications”, JOOP, XP002142904., (Jul. 1999), 3.Applicant
- Srinivasan, V. , et al., “Object Persistence in Object-Oriented Applications”, IBMSystems Journal, IBM Corp., vol. 36, No. 1, 1997, pp. 11, XP000685709, ISSN: 0018-8670.Applicant
- Stark, “Concurrent Programming In Java”, CS2 Advanced Programming in Java note 9, S2Bh, (Jan. 3, 2002), 1-5.Applicant
- Tullman, Patrick , et al., “Janos: A Java-Oriented OS for Active Network Nodes”, Paper, Flux Research Group, University of Utah, (Mar. 2001), 14.Applicant
- Tuttle, Steven , et al., “Understanding LDAP Design and Implemenation”, IBM.com Redbooks, (Jun. 2004), 1-774.Applicant
- “FOA Mailed Aug. 13, 2008 for U.S. Appl. No. 11/013,278, Whole Document”, (Aug. 13, 2008).Applicant
- Cheung, KC , et al., “Lightweight Trace and Interpreter for Inter-process Timing Problems”, IP.COM Journal, IP.COM Inc., West Henrietta, NY US, XP013096988, ISSN: 1533-0001, (Jun. 1, 1992), Whole Document.Applicant
- EPO, “EP EP Search Report Mailed Jun. 4, 2008 for EP Patent Application 05027365.5-1225”, (Jun. 4, 2008), Whole Document.Applicant
- Galchev, Galin , “Plug-In Based Caching Architecture Capable Of Implementing Multiple Cache Regions Per Application”, U.S. Appl. No. 11/024,554, filed Dec. 28, 2004, Non-Final Office Action mailed May 28, 2008, 7 pgs.Applicant
- Galchev, Galin , et al., “Plug-In Based Caching Architecture Capable Of Implementing Multiple Cache Regions Per Application”, U.S. Appl. No. 11/024,554, filed Dec. 28, 2004.Applicant
- Petev, Petio , et al., “Common Cache Management in a Plurality of Virtual Machines”, U.S. Appl. No. 11/025,482, filed Dec. 28, 2004.Applicant
- Petev, Petio , et al., “First In First Out Eviction Implementation”, U.S. Application 11/024,546, filed Dec. 28, 2004.Applicant
- Petev, Petio G., et al., “Programming Models for Storage Plug-Ins”, U.S. Appl. No. 11/024,651, filed Dec. 28, 2004.Applicant
- Petev, Petio , et al., “Size Based Eviction Implementation”, U.S. Appl. No. 11/024,591, filed Dec. 28, 2004.Applicant
- USPTO, “FOA Mailed Sep. 17, 2008, for U.S. Appl. No. 11/024,392”, filed Sep. 17, 2008, Whole Document.Applicant
- Viswanathan, D. , et al., “Java Virtual Machine Profiler Interface”, IBM Systems Journal IBM USA, vol. 39, No. 1, XP002481425, ISSN: 0018-8670, (2000), 82-95.Applicant
- Wintergerst, Michael , “Storage Plugin Based on Shared Closures”, U.S. Appl. No. 11/024,613 filed Dec. 28, 2004.Applicant
- Wolczko, Mario , “Using a Tracing Java Virtual Machine to Gather Data on the Behavior of Java Programs”, Internet Citation, XP002375976, http://research.sun.com/people/mario/tracing-jvm/tracing.pdf, (Retrieved on Apr. 6, 2006), Whole Document.Applicant
- Non-Final Office Action for U.S. Appl. No. 11/013,278, Mailed Dec. 23, 2008, 28 pages.Applicant
- Non-Final Office Action for U.S. Appl. No. 11/012,803, Mailed Dec. 23, 2008, 22 pages.Applicant