US 6,346,948 B1Grant
Method and apparatus for pixel composition
Issue Date:2002-02-12
•66 Claims
•4 Drawing Sheets
Abstract
The present invention provides a method and apparatus that permits the introduction of customized compositing techniques into an application by a developer. A Composite interface and a CompositeContext interface are defined. Custom compositing operations can be defined by implementing these interfaces. A Composite object provides a CompositeContext object that holds the state and performs the compositing work. Multiple CompositeContext objects can be created from one Composite object to maintain separate states in a multi-threaded environment. An object implementing the Composite interface can be set as rendering state on a graphics object that provides rendering methods. This allows arbitrary compositing rules to be used by a developer. In one implementation of the Composite and CompositeContext interfaces, an AlphaComposite class is defined. The AlphaComposite class implements common compositing rules, such as defined by Porter and Duff, for combining source and destination pixels to achieve blending and transparency effects with graphics and images.
Metadata
Assignee
- Sun Microsystems, Inc.
Inventors
- Jerald Evans
- James Graham
- Thanh Nguyen
Application Information
Application Number:US 09/498,197
Filing Date:2000-02-04
Priority Date:1997-06-30
Art Unit:7
Classifications
IPC:
G06T 1160
Field of Search:
345435345430345431345582345597345619
Patent Drawings (4 sheets)
Description
[0002] This is a continuation of application Ser. No. 08/844,843 filed Jun. 30, 1997 now U.S. Pat. No. 6,034,694.
Background of the Present Invention
[0003] 1. Field of the Invention
[0004] This invention relates to the field of object-oriented computer graphics and imaging.
[0005] 2. Background Art
[0006] In computer graphics applications there is a technique for combining two images known as “compositing”. One example of compositing is the blending of a new screen object of one color with an existing screen object of another color. This color blend is accomplished using a well known compositing technique known as alpha compositing, such as described by T. Porter and T. Duff, “Compositing Digital Images”, SIGGRAPH 84, pp. 253-259. A problem with current schemes for providing compositing in computer systems is a difficulty in adding different compositing techniques. Currently, available compositing schemes are hard coded algorithms and are often tied to specific hardware implementations. This discourages or prevents the addition of customized compositing schemes.
Summary of the Invention
[0007] The present invention provides a method and apparatus that permits the introduction of customized compositing techniques into an application by a developer. A Composite interface and a CompositeContext interface are defined. Custom compositing operations can be defined by implementing these interfaces. A Composite object provides a CompositeContext object that holds the state and performs the compositing work. Multiple CompositeContext objects can be created from one Composite object to maintain separate states in a multi-threaded environment.
[0008] An object implementing the Composite interface can be set as rendering state on a graphics object that provides rendering methods. This allows arbitrary compositing rules to be used by a developer. In one implementation of the Composite and CompositeContext interfaces, an AlphaComposite class is defined. The AlphaComposite class implements common compositing rules, such as defined by Porter and Duff, for combining source and destination pixels to achieve blending and transparency effects with graphics and images.
Brief Description of the Figures
[0009] FIG. 1 is a block diagram of a computer system used with an embodiment of the invention.
[0010] FIG. 2 demonstrates the instantiation of multiple instances of the AlphaComposite class in the present invention.
[0011] FIG. 3 illustrates an example of the operation of a compositing class.
[0012] FIG. 4 illustrates an example of a Graphics2D object containing multiple rendering attributes.
Detailed Description of the Invention
[0013] A method and apparatus for implementing compositing operations is described. In the following description, numerous specific details are set forth in detail to provide a more thorough description of the present invention. It will be apparent, however, to one skilled in the art, that the present invention may be practiced without these specific details. In other instances, well known features have not been described in detail so as not to obscure the present invention.
[0014] An embodiment of the invention can be implemented as computer software in the form of computer readable program code executed on a general purpose computer such as computer 100 illustrated in FIG. 1. A keyboard 110 and mouse 111 are coupled to a bi-directional system bus 118. The keyboard and mouse are for introducing user input to the computer system and communicating that user input to central processing unit (CPU) 113. Other suitable input devices may be used in addition to, or in place of, the mouse 111 and keyboard 110. I/O (input/output) unit 119 coupled to bi-directional system bus 118 represents such I/O elements as a printer, A/V (audio/video) I/O, etc.
[0015] Computer 100 includes a video memory 114, main memory 115 and mass storage 112, all coupled to bi-directional system bus 118 along with keyboard 110, mouse 111 and CPU 113. The mass storage 112 may include both fixed and removable media, such as magnetic, optical or magnetic optical storage systems or any other available mass storage technology. Bus 118 may contain, for example, thirty-two address lines for addressing video memory 114 or main memory 115. The system bus 118 also includes, for example, a 32-bit data bus for transferring data between and among the components, such as CPU 113, main memory 115, video memory 114 and mass storage 112. Alternatively, multiplex data/address lines may be used instead of separate data and address lines.
[0016] In one embodiment of the invention, the CPU 113 is a microprocessor manufactured by Motorola, such as the 680X0 processor or a microprocessor manufactured by Intel, such as the 80X86, or Pentium processor, or a SPARC microprocessor from Sun Microsystems. However, any other suitable microprocessor or microcomputer may be utilized. Main memory 115 is comprised of dynamic random access memory (DRAM). Video memory 114 is a dual-ported video random access memory. One port of the video memory 114 is coupled to video amplifier 116. The video amplifier 116 is used to drive the cathode ray tube (CRT) raster monitor 117. Video amplifier 116 is well known in the art and may be implemented by any suitable apparatus. This circuitry converts pixel data stored in video memory 114 to a raster signal suitable for use by monitor 117. Monitor 117 is a type of monitor suitable for displaying graphic images.
[0017] Computer 100 may also include a communication interface 120 coupled to bus 118. Communication interface 120 provides a two-way data communication coupling via a network link 121 to a local network 122. For example, if communication interface 120 is an integrated services digital network (ISDN) card or a modem, communication interface 120 provides a data communication connection to the corresponding type of telephone line, which comprises part of network link 121. If communication interface 120 is a local area network (LAN) card, communication interface 120 provides a data communication connection via network link 121 to a compatible LAN. Wireless links are also possible. In any such implementation, communication interface 120 sends and receives electrical, electromagnetic or optical signals which carry digital data streams representing various types of information.
[0018] Network link 121 typically provides data communication through one or more networks to other data devices. For example, network link 121 may provide a connection through local network 122 to host computer 123 or to data equipment operated by an Internet Service Provider (ISP) 124. ISP 124 in turn provides data communication services through the world wide packet data communication network now commonly referred to as the “Internet” 125. Local network 122 and Internet 125 both use electrical, electromagnetic or optical signals which carry digital data streams. The signals through the various networks and the signals on network link 121 and through communication interface 120, which carry the digital data to and from computer 100, are exemplary forms of carrier waves transporting the information.
[0019] Computer 100 can send messages and receive data, including program code, through the network(s), network link 121, and communication interface 120. In the Internet example, server 126 might transmit a requested code for an application program through Internet 125, ISP 124, local network 122 and communication interface 120. In accord with the invention, one such downloaded application is the apparatus for pixel composition described herein.
[0020] The received code may be executed by CPU 113 as it is received, and/or stored in mass storage 112, or other non-volatile storage for later execution. In this manner, computer 100 may obtain application code in the form of a carrier wave.
[0021] The computer system described above is for purposes of example only. An embodiment of the invention may be implemented in any type of computer system or programming or processing environment.
[0022] The present invention provides interfaces that define the methods to compose a source drawing primitive or image with a drawing destination. Multiple object classes may be defined to implement the interfaces. The preferred embodiment of the invention is implemented in the Java 2D API developed by Sun Microsystems, Inc. of Mountain View, Calif. The following is background on Java and on object oriented programming.
[0023] Java is an object-oriented programming language. Object-oriented programming is a method of creating computer programs by combining certain fundamental building blocks, and creating relationships among and between the building blocks. The building blocks in object-oriented programming systems are called “objects.” An object is a programming unit that groups together a data structure (instance variables) and the operations (methods) that can use or affect that data. Thus, an object consists of data and one or more operations or procedures that can be performed on that data. The joining of data and operations into a unitary building block is called “encapsulation.”
[0024] An object can be instructed to perform one of its methods when it receives a “message.” A message is a command or instruction to the object to execute a certain method. It consists of a method selection (name) and a plurality of arguments that are sent to an object. A message tells the receiving object what operations to perform.
[0025] One advantage of object-oriented programming is the way in which methods are invoked. When a message is sent to an object, it is not necessary for the message to instruct the object how to perform a certain method. It is only necessary to request that the object execute the method. This greatly simplifies program development.
[0026] Object-oriented programming languages are predominantly based on a “class” scheme. The class-based object-oriented programming scheme is generally described in Lieberman, “Using Prototypical Objects to Implement Shared Behavior in Object-Oriented Systems,” OOPSLA 86 Proceedings, September 1986, pp. 214-223.
[0027] A class defines a type of object that typically includes both instance variables and methods for the class. An object class is used to create a particular instance of an object. An instance of an object class includes the variables and methods defined for the class. Multiple instances of the same class can be created from an object class. Each instance that is created from the object class is said to be of the same type or class.
[0028] A hierarchy of classes can be defined such that an object class definition has one or more subclasses. A subclass inherits its parent 's (and grandparent's etc.) definition. Each subclass in the hierarchy may add to or modify the behavior specified by its parent class.
[0029] To illustrate, an employee object class can include “name” and “salary” instance variables and a “set_salary” method. Instances of the employee object class can be created, or instantiated for each employee in an organization. Each object instance is said to be of type “employee.” Each employee object instance includes the “name” and “salary” instance variables and the “set_salary” method. The values associated with the “name” and “salary” variables in each employee object instance contain the name and salary of an employee in the organization. A message can be sent to an employee 's employee object instance to invoke the “set_salary” method to modify the employee 's salary (i.e., the value associated with the “salary” variable in the employee's employee object).
[0030] An object is a generic term that is used in the object-oriented programming environment to refer to a module that contains related code and variables. A software program can be written using an object-oriented programming language whereby the program 's functionality is implemented using objects.
[0031] Drawing Model
[0032] The Java 2D API uses the drawing model defined by the java.awt package for drawing to the screen: each Component object implements a paint method that is invoked automatically whenever something needs to be drawn. When paint is invoked, it is passed a Graphics object that knows how to draw into the component.
[0033] Assume a component whose job it is to draw a red rectangle. To draw the rectangle using java.awt, first implement Component.paint:
[0034] public void paint(Graphics g) {
[0035] g.setColor(Color.red);
[0036] g.fillRect(300, 300, 200, 100);
[0037] }
[0038] This example illustrates the basic drawing process for any component:
[0039] 1. Specify the rendering attributes for the shape to be drawn by calling one of the Graphics attribute methods, such as setColor.
[0040] 2. Define the shape to be drawn, such as a rectangle.
[0041] 3. Use the Graphics object to render the shape by calling one of the Graphics rendering methods, such as fillRect.
[0042] The basic drawing process is the same when using Java 2D API features. The Java 2D API provides additional features for specifying fancy paint styles, defining complex shapes, and controlling the rendering process. For instance, Graphics2D extends Graphics to support advanced drawing operations.
[0043] The Graphics2D object contains multiple rendering attributes which specify how particular rendering operations should be performed to implement the advanced drawing operations. FIG. 4 illustrates a sample Graphics2D object containing multiple rendering attributes. In FIG. 4, Graphics2D object 400 contains the following attributes: Color 401, Transform 402, Font 403, Stroke 404, Composite 405, and Clip 406. These attributes are represented by objects which contain rendering behavior definitions, including behavior parameters and methods for setting the parameters.
[0044] For example, Color 401 contains information regarding the color value of a drawing operation, and has constructors for creating Color objects with specific color values. Transform 402 contains information on a geometric transformation. Font 403 may contain information such as font style and family definitions for text drawing operations. Stroke 404 may contain pen style information such as pen shape and width, and line and segment characteristics. Clip 406 may contain information on how an image is clipped during rendering.
[0045] Composite 405 contains the definition of how images are combined, such as how pixels from two source images are blended to form pixels in a destination image. A Composite object may also have an associated context object or objects, such as Context0407 and ContextN 408 associated with Composite 405. The method for creating the composite context instances is provided within the composite object. The composite context object encapsulates the method for carrying out the compositing operation. Because the composite context object maintains state for specific compositing operations, multiple context objects may be instantiated in a multi-threaded environment to reflect the particular compositing state for individual threads.
[0046] Component.paint is overloaded to support the Java 2D API drawing features. Referring to our rectangle example, the red rectangle could be drawn by implementing Component.paint (Graphics2D ):
[0047] public void paint (Graphics2D g2d) {
[0048] / / 1. Specify the rendering attributes
[0049] g2d.setColor (Color.red);
[0050] / / 2. Define the shape. (Use Even-Odd rule.)
[0051] GeneralPath path=new GeneralPath(GeneralPath.EVEN_ODD);
[0052] path.moveTo(300.0f, 400.0f); / / lower left corner
[0053] path.lineTo(500.0f, 400.0f); / / lower right corner
[0054] path.lineTo(500.0f, 300.0f); / / upper right corner
[0055] path.lineTo(300.0f, 300.0f); / / upper left corner
[0056] path.closePath( ); / / close the rectangle
[0057] / / 3. Render the shape
[0058] g2d.fill(path);
[0059] }
[0060] The process is the same, but the Java 2D API class GeneralPath is used to define the rectangle. The GeneralPath class is defined in more detail in the co-pending patent application entitled “Representing a Path as an Object with Transformation Capability” Ser. No. 08/885,620 filed on Jun. 30, 1997, assigned to the assignee of the present invention, and incorporated herein by reference.
[0061] 1. Specify the Rendering Attributes
[0062] With the Java 2D API classes, a shape may be filled with a solid color, but the Java 2D API also supports more complex fills such as gradients and patterns, as well as programmable compositing operations.
[0063] 2. Define a Shape, a Text String, or an Image
[0064] The Java 2D API treats paths, text, and images uniformly; they can all be rotated, scaled, skewed, and composited. In this example, a single rectangle is defined.
[0065] The Java 2D API provides an implementation of the Shape interface that can be used to define complex shapes. This class, GeneralPath, allows you to describe a shape using a combination of lines and Bezier curves.
[0066] Using GeneralPath to define a shape also allows you to control the location of the shape. (The shape can also be translated to a new position using the Graphics 2D transformation attribute.)
[0067] Winding Rules
[0068] The GeneralPath constructor takes a parameter that specifies the winding rule to be used for the object. The winding rule is used to determine whether or not a point lies inside the shape when path segments cross. Two different winding rules can be specified for a GeneralPath object: the even-odd winding rule or the nonzero winding rule. The even-odd rule is specified in this example, but has no effect as the path segments in the rectangle do not cross.
[0069] 3. Render the Shape, Text String, or Image.
[0070] To actually render the shape, text, or image, call the Graphics2D rendering methods. In this example, the rectangle is rendered using fill.
[0071] Transformations
[0072] In the Java 2D API, objects are processed by an AffineTransform associated with the Graphics2D object before they are drawn. An AffineTransform object takes a point or a path and transforms it to a new point or path. The default AffineTransform object created when the Graphics2D object is constructed performs simple scaling to device coordinates. To get effects such as rotation, translation, or custom scaling, create an AffineTransform object and apply it to the Graphics2D object.
[0073] Managing Complex Drawing Operations
[0074] Suppose that you want to draw a second rectangle, covering part of the first rectangle, rotated 45° counterclockwise. The new rectangle is filled with blue and rendered 50% transparent, so that the original rectangle is still visible underneath. With the Java 2D API, the second rectangle can easily be added to the previous example:
[0075] public void paint (Graphics 2D g2d) {
[0076] g2d.setColor (Color.red);
[0077] / / 2. Define the shape. (Use Even-Odd rule.)
[0078] GeneralPath path=new GeneralPath(GeneralPath.EVEN_ODD);
[0079] path.moveTo(0.0f, 0.0f); / / lower left corner
[0080] path.lineTo(200.0f, 0.0f); / / lower right corner
[0081] path.lineTo(200.0f, −100.0f); / / upper right corner
[0082] path.lineTo(0.0f, −100.0f); / / upper left corner
[0083] path.closePath( ); / / close the rectangle
[0084] AffineTransform at=new AffineTransform( );
[0085] at.setToTranslation (300.0, 400.0);
[0086] g2d.transform(at);
[0087] g2d.fill(path);
[0088] / / Add a second rectangle
[0089] g2d.setColor(Color.blue); / / define the color
[0090] AlphaComposite comp=
[0091] AlphaComposite.getInstance(Alphacomposite.SRC_OVER, 0.5);
[0092] g2d.setComposite(comp); / / set the composite mode
[0093] / / Rotate about the origin −45 degrees in radians
[0094] at.setToRotation (−Math.PI/4.0);
[0095] g2d.transform(at);
[0096] g2d.fill(path);
[0097] }
[0098] The drawing process is the same for both rectangles:
[0099] *The rectangle is defined using a GeneralPath object.
[0100] *The rendering attributes are set by calling setColor. For the second rectangle, setcomposite is called as well.
[0101] *Transformations are applied before the rectangle is rendered.
[0102] (Graphics2d.transform is used to position both rectangles at (300,400) and rotate the blue rectangle 45° counterclockwise.)
[0103] *The rectangle is rendered by calling fill. In addition, before the blue rectangle is rendered, a compositing operation is specified by creating an instance of Alpha Composite.
[0104] 1. Defining the Color and Composite
[0105] To paint the second rectangle with a 50% transparent blue, you first set the color to be painted.
[0106] Then, you indicate how the new color blends with existing colors. To do this, create an AlphaComposite object. An AlphaComposite object specifies how colors are blended. In this case, create an AlphaComposite object that sets the transparency for rendering to 50% and blends the new color over the existing color. To do this, specify the SRC_OVER operation and an alpha value of 0.5 when you create the AlphaComposite object. Then call Graphics2D .setComposite to use the new Composite object.
[0107] 2. Defining the Rotation
[0108] The rotation is performed by creating a new AffineTransform and calling setToRotation to specify the counterclockwise rotation of 45 degrees. The transform is then composed with the previous transform of the Graphics2D object (the translation to (300,400)) by calling Graphics2D. transform.
[0109] 3. Rendering the Blue Rectangle
[0110] Just like the first rectangle, the blue rectangle is rendered by calling fill.
[0111] The Graphics2D object transforms the path, using the specified AffineTransform object. The result is a rotated rectangle. It uses the specified color, blue, to determine what color the output should be. This color is then blended with the colors of the underlying image, based on the state of the Composite object and the Color object.
[0112] Composite
[0113] In the present invention, the AlphaComposite class is an implementation of the Composite interface. This class supports a number of different composition styles. Instances of this class embody a composition rule that describes how to blend a new color with an existing one. The alpha values for rendering are derived from a Color, Paint, or Image object, combined with pixel coverage information from a rasterized path (when antialiased rendering is being performed).
[0114] Managing Transparency
[0115] One commonly used compositing rule in the Alpha Composite class is SRC_OVER. When AlphaComposite.SRC_OVER is applied, it indicates that the new color (the source color) should be blended over the existing color (the destination color). The alpha value indicates, as a percentage, how much of the existing color should show through the new color. It is a measure of the transparency of the new color. Opaque colors don't allow any existing color to show through, while transparent colors let all of the existing color show through.
[0116] An AlphaComposite object can be used to add an additional level of transparency to what is drawn. To do this, create an alpha Composite object with an alpha value that increases the transparency of every object drawn:
[0117] comp=AlphaComposite.getInstance(AlphaComposite.SRC_OVER, 0.5);
[0118] The specified alpha value, 0.5, is combined with the alpha values of a Color, Paint, or Image prior to rendering. This reduces the alpha of everything drawn by 50%, making everything 50% more transparent.
[0119] A new type of compositing operation can be created by implementing the Composite and CompositeContext interfaces. A Composite object provides a CompositeContext object that actually holds the state and performs the composite work. Multiple CompositeContext objects can be created from one Composite object to maintain the separate states in a multi-threaded environment. The Composite and CompositeContext interfaces are described below.
[0120] Composite Interface
[0121] The Composite interface is a public interface, and, together with the CompositeContext interface, defines the methods to compose a source drawing primitive or image with the underlying graphics area. The Composite is set in the Graphics2D object and thereafter, whenever a shape, text, or an image is drawn, the Composite will combine the source with the colors that have already been drawn, according to rules defined by the Composite object. The classes implementing this interface will provide the rules and a method to create the context for a particular operation. CompositeContext is an environment used by the compositing operation that a Graphics2D object must create prior to the start of the operation. CompositeContext contains various private information and resources needed for a compositing operation. When the CompositeContext is no longer needed it is disposed of by the Graphics2D object to reclaim resources allocated for the operation.
[0122] Instances of classes implementing Composite should be immutable (i.e. read-only) because the Graphics2D object does not clone these objects when they are set as an attribute with the setComposite method or when the Graphics2D object is itself cloned. This is to avoid undefined behavior of Graphics2D rendering which would result if the Composite object were modified after being set in the Graphics2D state.
[0123] In the preferred embodiment of the present invention, a method of the Composite interface is createContext (public abstract CompositeContext createContext (ColorModel srcColorModel, ColorModel dstColorModel)). This method creates a context for the compositing operation. The context contains state that is used to perform the compositing operation. In a multi-threaded environment several contexts may exist simultaneously for a single Composite object. The parameters srcColorModel and dstColorModel are the ColorModel of the source and destination respectively. The method returns the CompositeContext object to perform the compositing operation.
[0124] CompositeContext Public Interface
[0125] The CompositeContext interface defines the encapsulated and optimized environment for the compositing operation. CompositeContext objects maintain state for compositing operations. In a multi-threaded environment, several contexts may exist simultaneously for a single Composite object.
[0126] Methods
[0127] disposeContext
[0128] public abstract void dispose( )
[0129] Release resources allocated for context.
[0130] compose
[0131] public abstract void compose(Tile src1, Tile src2, Tile dst)
[0132] This method composes the first source tile with the second source tile and places the result in the destination tile. If one of the source tiles is the same as the destination tile, then the operation is effectively a single source to single destination compose operation.
[0133] Parameters:
[0134] src1—The first source tile for the compositing operation.
[0135] src2—The second source tile for the compositing operation.
[0136] dst—The destination tile for the result of the compositing operation.
[0137] The Composite Interface is implemented in one embodiment of this invention by an AlphaComposite class described below.
[0138] AlphaComposite Public Class
[0139] This class implements basic alpha compositing rules for combining 10 source and destination pixels to achieve blending and transparency effects with graphics and images. The rules implemented by this class are a subset of the Porter-Duff rules described in T. Porter and T. Duff, “Compositing Digital Images”, SIGGRAPH 84, pp. 253-259 of Appendix A.
[0140] If any input does not have an alpha channel, an alpha value of 1.0 (completely opaque) is assumed for all pixels.
[0141] A constant alpha value can also be specified to be multiplied with the alpha value of the source pixels.
[0142] The following description is in terms of a single source to single destination compositing operation. The following abbreviations are used in the description of the rules:
[0143] Cs=one of the Color components of the Source Pixel.
[0144] Cd=one of the Color components of the Destination Pixel.
[0145] As=Alpha component of the Source Pixel.
[0146] Ad=Alpha component of the Destination Pixel.
[0147] Fs=fraction of the Source Pixel which contributes to the output.
[0148] Fd=fraction of the input Destination Pixel which contributes to the output.
[0149] The color and alpha components produced by the compositing operation are calculated as follows:
[0150] Cd=Cs*Fs+Cd*Fd
[0151] Ad=As*Fs+Ad*Fd
[0152] where Fs and Fd are specified by each rule. The above equations assume that both source and destination pixels have the color components premultiplied by the alpha component. Similarly, the equations expressed in the definitions of compositing rules below assume premultiplied alpha.
[0153] For performance reasons, it is preferable that Tiles passed to the compose method of a CompositeContext object created by the AlphaComposite class have premultiplied data. However, if either source or destination Tiles are not premultiplied, appropriate conversions are performed before and after the compositing operation.
[0154] The resulting alpha of the compositing operation is stored in the destination if the destination has an alpha channel. Otherwise, the resulting color is divided by the resulting alpha before being stored in the destination and the alpha is discarded (if the alpha value is 0.0, the color values are set to 0.0).
[0155] Variables
[0156] CLEAR
[0157] public final static int CLEAR
[0158] Porter-Duff Clear rule. Both the color and the alpha of destination are cleared. Neither the source nor the destination is used as input.
[0159] With Fs=0 and Fd=0:
[0160] Cd=0
[0161] Ad=0
[0162] SRC
[0163] public final static int SRC
[0164] Porter-Duff Source rule. The source is copied to the destination. The destination is not used as input.
[0165] With Fs=1 and Fd=0:
[0166] Cd=Cs
[0167] Ad=As
[0168] SRC_OVER
[0169] public final static int SRC_OVER
[0170] Porter-Duff Source Over Destination rule. The source is composited over the destination.
[0171] With Fs=1 and Ed=(1−As):
[0172] Cd=Cs+Cd*(1−As)
[0173] Ad=As+Ad*(1−As)
[0174] DST_OVER
[0175] public final static int DST_OVER
[0176] Porter-Duff Destination Over Source rule. The destination is composited over the source and the result replaces the destination.
[0177] With Fs=(1−Ad) and Fd=1:
[0178] Cd=Cs*(1−Ad)+Cd
[0179] Ad=As*(1−Ad)+Ad
[0180] SRC_IN
[0181] public final static int SRC_IN
[0182] Porter-Duff Source In Destination rule. The part of the source lying inside of the destination replaces the destination.
[0183] With Fs=Ad and Fd=0:
[0184] Cd=Cs*Ad
[0185] Ad=As*Ad
[0186] DST_IN
[0187] public final static int DST_IN
[0188] Porter-Duff Destination In Source rule. The part of the destination lying inside of the source replaces the destination.
[0189] With Fs=0 and Fd=As:
[0190] Cd=Cd*As
[0191] Ad=Ad*As
[0192] SRC_OUT
[0193] public final static int SRC_OUT
[0194] Porter-Duff Source Held Out By Destination rule. The part of the source lying outside of the destination replaces the destination.
[0195] With Fs=(1−Ad) and Fd=0:
[0196] Cd=Cs*(1−Ad)
[0197] Ad=As*(1−Ad)
[0198] DST_OUT
[0199] public final static int DST_OUT
[0200] Porter-Duff Destination Held Out By Source rule. The part of the destination lying outside of the source replaces the destination.
[0201] With Fs=0 and Fd=(1−As):
[0202] Cd=Cd*(1−As)
[0203] Ad=Ad*(1−As)
[0204] Methods of AlphaComposite Class
[0205] getInstance
[0206] public static AlphaComposite getInstance(int rule)
[0207] Returns an AlphaComposite object with the given rule.
[0208] Parameters:
[0209] rule—Rule for the composition.
[0210] getInstance
[0211] public static AlphaComposite getInstance(int rule,
[0212] float alpha)
[0213] Returns an AlphaComposite object with the given rule and the constant alpha to multiply with the alpha of the source. The source is multiplied with the given alpha before being composited with the destination.
[0214] Parameters:
[0215] rule—Rule for the composition.
[0216] alpha—The constant alpha to be multiplied with the alpha of the source.
[0217] Alpha should be a floating point number in the range 0.0-1.0.
[0218] createContext
[0219] public CompositeContext createContext(ColorModel srcColorModel,
[0220] ColorModel dstColorModel)
[0221] Creates a context for the compositing operation. The context contains state that is used in performing compositing operations.
[0222] Parameters:
[0223] srcColorModel—The ColorModel of the source.
[0224] dstColorModel—The ColorModel of the destination.
[0225] Returns:
[0226] The CompositeContext object to be used to perform compositing operations.
[0227] getAlpha
[0228] public float getAlpha( )
[0229] Returns the additional alpha value that was given when this AlphaComposite instance was created. If this instance was created without the additional alpha value, the value 1.0 is returned.
[0230] getRule
[0231] public int getRule( )
[0232] Returns the compositing rule that was specified when this AlphaComposite instance was created.
[0233] FIG. 2 illustrates the creation of multiple instances of the AlphaComposite class using the preferred embodiment of the present invention. The AlphaComposite class 201 is defined for performing compositing operations. Class 201 implements Composite interface 202. The Composite interface allows creation of a CompositeContext object for performing compositing operations according to one of the predefined rules.
[0234] A CompositeContext object 203 is created by the AlphaComposite class (or any other defined class that implements the Composite interface) when requested by a Graphics2D object or any other object which uses a class implementing the Composite interface for purposes of performing compositing during rendering. The CompositeContext object defines the environment for a compositing operation. Instances of the AlphaComposite class 201 may be instantiated as shown by instances 204-211 in FIG. 2. In the example of FIG. 2, each of the instances represents a rule to control a compositing operation. Instance 204 represents the CLEAR rule, instance 205 represents the SRC rule, instance 206 the SRC_OVER rule, instance 207 the DST_OVER rule, instance 208 the SRC_OUT rule, instance 209 the DST_IN rule, instance 210 the SRC_OUT
[0235] rule, and instance 211 the DST_OUT rule.
[0236] The AlphaComposite class is just one example of a class that implements the Composite interface. By taking advantage of the present invention, other compositing classes can be defined as desired. An example of the form that a compositing class should follow is illustrated in FIG. 3. In the preferred embodiment, a compositing class should be able to create a context as illustrated at block 301. Parameters for the context may include a srcColorModel and a dstColorModel as shown at block 304. The compositing class should be able to provide instances of itself which support compositing operations using one or more algorithms, e.g., by supporting a set of predefined rules, as illustrated at block 302. In the example shown, the rules are the alpha compositing rules of block 305 and described above in the AlphaComposite class. A compositing class may also be able to return information about the particular compositing algorithm implemented by an instance of the class, e.g., by indicating one of a set of predefined rules, as shown at block 303.
[0237] Thus, a method and apparatus for providing programmable pixel composition has been described.
[Inline image omitted. See PDF.]
[Inline image omitted. See PDF.]
[Inline image omitted. See PDF.]
[Inline image omitted. See PDF.]
[Inline image omitted. See PDF.]
[Inline image omitted. See PDF.]
[Inline image omitted. See PDF.]
[Inline image omitted. See PDF.]
[Inline image omitted. See PDF.]
[Inline image omitted. See PDF.]
[Inline image omitted. See PDF.]
[Inline image omitted. See PDF.]
[Inline image omitted. See PDF.]
[Inline image omitted. See PDF.]
Claims
What is claimed is:
1. In an object-oriented computer system, a method for defining compositing operations in a graphics environment, said method comprising the steps of:
creating a first object comprising a rendering method;
creating a second object, said second object defining rules for a compositing operation, said second object comprising a method for creating an instance of a third object;
creating said third object, said third object comprising a method for compositing image elements.
2. The method of claim 1 further comprising the step of said second object implementing a composite interface.
3. The method of claim 2 further comprising the step of defining in said composite interface said method for creating instances.
4. The method of claim 1 further comprising the step of setting said second object as a rendering attribute of said first object.
5. The method of claim 1 further comprising the step of said third object implementing a composite context interface.
6. The method of claim 5 further comprising the step of defining in said composite context interface said method for compositing.
7. The method of claim 1 further comprising the step of said third object maintaining state for said compositing operation.
8. The method of claim 1 further comprising the step of invoking said method for compositing when said rendering method is executed.
9. The method of claim 8, wherein said step of invoking said method for compositing comprises the step of passing at least one source image element and a destination image element to said third object.
10. The method of claim 1 further comprising the step of creating multiple instances of said third object in a multi-threaded environment.
11. The method of claim 1, wherein said step of creating said third object comprises the step of passing a source color representation and a destination color representation to said third object to define a compositing environment.
12. The method of claim 1, wherein said second object comprises an alpha composite object, and said step of creating said second object comprises the step of passing a rule argument and an alpha value.
13. The method of claim 12, wherein said alpha value comprises at least one increased level of transparency for at least one destination pixel.
14. The method of claim 1 wherein said method for compositing image elements comprises a method of combining source pixels with destination pixels.
15. The method of claim 1 wherein said method for compositing image elements comprises a method of blending pixels from more than one source into a destination image.
16. The method of claim 1 wherein said method for compositing image elements comprises a method of rotating a set of image points into a new set of image points.
17. The method of claim 1 wherein said method for compositing image elements comprises a method of translating a set of image points into a new set of image points.
18. The method of claim 1 wherein said method for compositing image elements comprises a method of scaling a set of image points into a new set of image points.
19. The method of claim 1 wherein said method for compositing image elements comprises a method of rotating an image path into a new image path.
20. The method of claim 1 wherein said method for compositing image elements comprises a method of translating an image path into a new image path.
21. The method of claim 1 wherein said method for compositing image elements comprises a method of scaling an image path into a new image path.
22. In an object-oriented computer system, a method for defining compositing operations in a graphics environment, said method comprising the steps of:
creating a first object comprising a rendering method;
creating a second object, said second object implementing a composite interface, said second object defining rules for a compositing operation, said second object comprising a method for creating an instance of a third object;
setting said second object as a rendering attribute of said first object;
creating said third object, wherein said creating said third object comprises passing a source color representation and a destination color representation to said third object to define a compositing environment, said third object implementing a composite context interface, said third object comprising a method for compositing image elements, said third object maintaining state for said compositing operation;
invoking said method for compositing when said rendering method is executed, wherein said step of invoking comprises passing at least one source image element and a destination image element to said third object.
23. A computer system comprising:
a processor;
program code executed by said processor, said program code comprising;
a first object comprising a rendering method;
a second object defining rules for a compositing operation, said second object comprising a method for creating an instance of a third object;
said third object comprising a method for compositing image elements.
24. The computer system of claim 23, further comprising said second object implementing a composite interface.
25. The computer system of claim 24, wherein said composite interface defines said method for creating instances.
26. The computer system of claim 23, further comprising said a second object set as a rendering attribute of said first object.
27. The computer system of claim 23, further comprising said third object implementing a composite context interface.
28. The computer system of claim 27, wherein said composite context interface defines said method for compositing.
29. The computer system of claim 23, further comprising said third object maintaining state for said compositing operation.
30. The computer system of claim 23, further comprising invoking said method for compositing when said rendering method is executed.
31. The computer system of claim 30, wherein said method for compositing accepts as arguments at least one source image element and a destination image element.
32. The computer system of claim 23 further comprising multiple instances of said third object in a multi-threaded environment.
33. The computer system of claim 23, wherein said third object defines a compositing environment based upon arguments provided to said method for creating an instance.
34. The computer system of claim 23, wherein said second object comprises an alpha composite object implementing one of multiple defined alpha compositing rules.
35. The computer system of claim 34, wherein said one of multiple defined alpha compositing rules comprises at least one increased level of transparency for at least one destination pixel.
36. The computer system of claim 23 wherein said method for compositing image elements comprises a method of combining source pixels with destination pixels.
37. The computer system of claim 23 wherein said method for compositing image elements comprises a method of blending pixels from more than one source into a destination image.
38. The computer system of claim 23 wherein said method for compositing image elements comprises a method of rotating a set of image points into a new set of image points.
39. The computer system of claim 23 wherein said method for compositing image elements comprises a method of translating a set of image points into a new set of image points.
40. The computer system of claim 23 wherein said method for compositing image elements comprises a method of scaling a set of image points into a new set of image points.
41. The computer system of claim 23 wherein said method for compositing image elements comprises a method of rotating an image path into a new image path.
42. The computer system of claim 23 wherein said method for compositing image elements comprises a method of translating an image path into a new image path.
43. The computer system of claim 23 wherein said method for compositing image elements comprises a method of scaling an image path into a new image path.
44. A computer system comprising:
a processor;
program code executed by said processor, said program code comprising;
a first object comprising a rendering method;
a second object set as a rendering attribute of said first object, said second object implementing a composite interface and defining rules for a compositing operation, said second object comprising a method for creating an instance of a third object, wherein said creating said third object comprises passing a source color representation and a destination color representation to said third object to define a compositing environment;
said third object implementing a composite context interface, said third object maintaining state for said compositing operation and comprising a method for compositing image elements, wherein said method for compositing is invoked when said rendering method is executed, wherein said invoking comprises passing at least one source image element and a destination image element to said third object.
45. A computer program product comprising:
a computer usable medium having computer program code embodied therein for performing compositing operations in a graphics environment, said computer program product comprising:
computer program code configured to cause a computer to create a first object comprising a rendering method;
computer program code configured to cause a computer to create a second object, said second object defining rules for a compositing operation, said second object comprising a method for creating an instance of a third object;
computer program code configured to cause a computer to create said third object, said third object comprising a method for compositing image elements.
46. The computer program product of claim 45, further comprising said second object implementing a composite interface.
47. The computer program product of claim 46, wherein said method for creating instances is defined in said composite interface.
48. The computer program product of claim 45, further comprising computer program code configured to cause a computer to set said second object as a rendering attribute of said first object.
49. The computer program product of claim 45, further comprising said third object implementing a composite context interface.
50. The computer program product of claim 49, wherein said method for compositing is defined in said composite context interface.
51. The computer program product of claim 45, further comprising said third object maintaining state for said compositing operation.
52. The computer program product of claim 45, further comprising computer program code configured to cause a computer to invoke said method for compositing when said rendering method is executed.
53. The computer program product of claim 52, wherein said computer program code configured to cause a computer to invoke said method for compositing comprises computer program code configured to cause a computer to pass at least one source image element and a destination image element to said third object.
54. The computer program product of claim 45 further comprising computer program code configured to cause a computer to create multiple instances of said third object in a multi-threaded environment.
55. The computer program product of claim 45, wherein said computer program code configured to cause a computer to create said third object comprises computer program code configured to cause a computer to pass a source color representation and a destination color representation to said third object to define a compositing environment.
56. The computer program product of claim 45, wherein said second object comprises an alpha composite object, and said computer program code configured to cause a computer to create said second object comprises computer program code configured to cause a computer to pass a rule argument and an alpha value.
57. The computer program product of claim 56, wherein said alpha value comprises at least one increased level of transparency for at least one destination pixel.
58. The computer program product of claim 45 wherein said method for compositing image elements comprises a method of combining source pixels with destination pixels.
59. The computer program product of claim 45 wherein said method for compositing image elements comprises a method of blending pixels from more than one source into a destination image.
60. The computer program product of claim 45 wherein said method for compositing image elements comprises a method of rotating a set of image points into a new set of image points.
61. The computer program product of claim 45 wherein said method for compositing image elements comprises a method of translating a set of image points into a new set of image points.
62. The computer program product of claim 45 wherein said method for compositing image elements comprises a method of scaling a set of image points into a new set of image points.
63. The computer program product of claim 45 wherein said method for compositing image elements comprises a method of rotating an image path into a new image path.
64. The computer program product of claim 45 wherein said method for compositing image elements comprises a method of translating an image path into a new image path.
65. The computer program product of claim 45 wherein said method for compositing image elements comprises a method of scaling an image path into a new image path.
66. A computer program product comprising:
a computer usable medium having computer program code embodied therein for performing compositing operations in a graphics environment, said computer program product comprising:
computer program code configured to cause a computer to create a first object comprising a rendering method;
computer program code configured to cause a computer to create a second object, said second object implementing a composite interface, said second object defining rules for a compositing operation, said second object comprising a method for creating an instance of a third object;
computer program code configured to cause a computer to set said second object as a rendering attribute of said first object;
computer program code configured to cause a computer to create said comprising a method for creating an instance of a third object;
computer program code configured to cause a computer to set said second object as a rendering attribute of said first object;
computer program code configured to cause a computer to create said third object, wherein said creating said third object comprises passing a source color representation and a destination color representation to said third object to define a compositing environment; said third object implementing a composite context interface, said third object comprising a method for compositing image elements, said third object maintaining state for said compositing operation;
computer program code configured to cause a computer to invoke said method for compositing when said rendering method is executed, wherein said step of invoking comprises passing at least one source image element and a destination image element to said third object.
Patent Citations (36)
| Patent | Date | Inventor | Cited By |
|---|---|---|---|
| US5291585(A) | 1994-03-01 | Sato et al. | Applicant |
| US5335320(A) | 1994-08-01 | Iwata et al. | Applicant |
| US5345550(A) | 1994-09-01 | Bloomfield | Applicant |
| US5347627(A) | 1994-09-01 | Hoffmann et al. | Applicant |
| US5384911(A) | 1995-01-01 | Bloomfield | Applicant |
| US5412772(A) | 1995-05-01 | Monson | Applicant |
| US5414806(A) | 1995-05-01 | Richards | Applicant |
| US5423034(A) | 1995-06-01 | Cohen-Levy et al. | Applicant |
| US5430836(A) | 1995-07-01 | Wolf et al. | Applicant |
| US5436637(A) | 1995-07-01 | Gayraud et al. | Applicant |
| US5448695(A) | 1995-09-01 | Douglas et al. | Applicant |
| US5461399(A) | 1995-10-01 | Cragun | Applicant |
| US5461710(A) | 1995-10-01 | Bloomfield et al. | Applicant |
| US5473745(A) | 1995-12-01 | Berry et al. | Applicant |
| US5491784(A) | 1996-02-01 | Douglas et al. | Applicant |
| US5493638(A) | 1996-02-01 | Hooper et al. | Applicant |
| US5509116(A) | 1996-04-01 | Hiraga et al. | Applicant |
| US5526517(A) | 1996-06-01 | Jones et al. | Applicant |
| US5544288(A) | 1996-08-01 | Morgan et al. | Applicant |
| US5546519(A) | 1996-08-01 | Berry | Applicant |
| US5548702(A) | 1996-08-01 | Li et al. | Applicant |
| US5550968(A) | 1996-08-01 | Miller et al. | Applicant |
| US5559942(A) | 1996-09-01 | Gough et al. | Applicant |
| US5564003(A) | 1996-10-01 | Bell et al. | Applicant |
| US5566330(A) | 1996-10-01 | Sheffield | Applicant |
| US5570462(A) | 1996-10-01 | McFarland | Applicant |
| US5572643(A) | 1996-11-01 | Judson | Applicant |
| US5638499(A) | 1997-06-01 | O'Connor et al. | Examiner |
| US5638502(A) | 1997-06-01 | Murata | Applicant |
| US5652851(A) | 1997-07-01 | Stone et al. | Applicant |
| US5694603(A) | 1997-12-01 | Reiffin | Applicant |
| US5694604(A) | 1997-12-01 | Reiffin | Applicant |
| US5740343(A) | 1998-04-01 | Tarolli et al. | Examiner |
| US5745121(A) | 1998-04-01 | Politis | Examiner |
| US6034694(A) | 2000-03-01 | Evans et al. | Examiner |
| US6130676(A) | 2000-10-01 | Wise et al. | Examiner |
Non-Patent Literature (4)
- Ronald L. Johnston, “The Dynamic Incremental Compiler of APL/3000” Proceedings of the API '79 Conference, published as APL Quote Quad, 9(4), p 82-87.Applicant
- Leo J. Guibas et al., “Compilation and Delayed Evaluation in APL,” Fifth Annual Synposium on Principles in Programming Languages, p 1-8, 1978.Applicant
- Gleen Krasner “The Smalltalk-80 Virtual Machine” BYTE Publications Inc., Aug. 1991, pp 300-320.Applicant
- Thomas Porter et al. “Compositing Digital Images” Association for Computing Machinery (ACM), 1984, pp. 253-259.Applicant