US 7,392,248 B2Grant
Data aggregation server supporting rapid query response with sparse multi-dimensional data
Issue Date:2008-06-24
•35 Claims
•26 Drawing Sheets
Abstract
Improved method of and apparatus for joining and aggregating data elements integrated within a relational database management system (RDBMS) using a non-relational multi-dimensional data structure (MDD). The improved RDBMS system of the present invention can be used to realize achieving a significant increase in system performance (e.g. deceased access/search time), user flexibility and ease of use. The improved RDBMS system of the present invention can be used to realize an improved Data Warehouse for supporting on-line analytical processing (OLAP) operations or to realize an improved informational database system or the like.
Metadata
Assignee
- Hyperroll Israel, Ltd.
Inventors
- Reuven Bakalash
- Guy Shaked
- Joseph Caspi
Application Information
Application Number:US 10/314,868
Filing Date:2002-12-09
Priority Date:1999-08-04
Art Unit:2167
Classifications
IPC:
G06F17/30G06F7/00
Patent Drawings (26 sheets)
Description
Related Cases
[0001] This is a Continuation of application Ser. No. 10/136,937 filed May 1, 2002, now abandoned which is a Continuation of application Ser. No. 09/634,748 filed Aug. 9, 2000, now U.S. Pat. No. 6,385,604, which is a Continuation-in-part of: application Ser. No. 09/514,611 filed Feb. 28, 2000, now U.S. Pat. No. 6,434,544, and application Ser. No. 09/368,241 filed Aug. 4, 1999, now U.S. Pat. No. 6,408,292; said Applications being commonly owned by HyperRoll Israel, Limited, herein incorporated by reference in their entirety.
Background of the Invention
[0002] 1. Field of Invention
[0003] The present invention relates generally to multi-dimensional relational databases and, more specifically to mechanisms for aggregating data elements in a multi-dimensional relational database system and for processing queries on such aggregated data elements, and also to informational database systems that utilize multi-dimensional relational databases and such aggregation/query mechanisms.
[0004] 2. Brief Description of the State of the Art
[0005] Information technology (IT) enables an enterprise to manage and optimize its internal business practices through the analysis and sharing of data internally within the enterprise. In addition, IT enables an enterprise to manage and optimize its external business practices through the sharing of data with external parties such as suppliers, customers and investors, and through on-line transactions between the enterprise and external parties. Informational database systems (systems that store data, support query processing on the stored data, and possibly support analysis of the stored data) play a central role in many different parts of today's IT systems.
[0006] FIG. 1 illustrates exemplary domains where informational database systems are used. As shown, an operational environment 10 generates data which is stored in a data store 22 in the informational database system 20. These domains include data analysis systems (spread-sheet modeling programs, snap-shots, extraction, denormalization), data warehousing, data marts, OLAP systems, data mining systems, electronic commerce-enabled web servers, and business-to-business exchanges. Modern informational database systems typically use a relational database management system (RDBMS) as a repository for storing the data and querying the data.
[0007] FIG. 2 illustrates a data warehouse-OLAP domain that utilizes the prior art approaches described above. The data warehouse is an enterprise-wide data store. It is becoming an integral part of many information delivery systems because it provides a single, central location where a reconciled version of data extracted from a wide variety of operational systems is stored. Details on methods of data integration and constructing data warehouses can be found in the white paper entitled “Data Integration: The Warehouse Foundation” by Louis Rollleigh and Joe Thomas, published at http://www.acxiom.com/whitepapers/wp-11.asp. Building a Data Warehouse has its own special challenges (e.g. using common data model, common business dictionary, etc.) and is a complex endeavor. However, just having a Data Warehouse does not provide organizations with the often-heralded business benefits of data warehousing. To complete the supply chain from transactional systems to decision maker, organizations need to deliver systems that allow knowledge workers to make strategic and tactical decisions based on the information stored in these warehouses. These decision support systems are referred to as On-Line Analytical Processing (OLAP) systems. Such OLAP systems are commonly classified as Relation OLAP systems or Multi-Dimensional OLAP systems.
[0008] The Relational OLAP (ROLAP) system accesses data stored in a Data Warehouse to provide OLAP analyses. The premise of ROLAP is that OLAP capabilities are best provided directly against the relational database, i.e. the Data Warehouse. The ROLAP architecture was invented to enable direct access of data from Data Warehouses, and therefore support optimization techniques to meet batch window requirements and provide fast response times. Typically, these optimization techniques include application-level table partitioning, pre-aggregate inferencing, denormalization support, and the joining of multiple fact tables.
[0009] A typical ROLAP system has a three-tier or layer client/server architecture. The “database layer” utilizes relational databases for data storage, access, and retrieval processes. The “application logic layer” is the ROLAP engine which executes the multidimensional reports from multiple users. The ROLAP engine integrates with a variety of “presentation layers,” through which users perform OLAP analyses. After the data model for the data warehouse is defined, data from on-line transaction-processing (OLTP) systems is loaded into the relational database management system (RDBMS). If required by the data model, database routines are run to pre-aggregate the data within the RDBMS. Indices are then created to optimize query access times. End users submit multidimensional analyses to the ROLAP engine, which then dynamically transforms the requests into SQL execution plans. The SQL execution plans are submitted to the relational database for processing, the relational query results are cross-tabulated, and a multidimensional result data set is returned to the end user. ROLAP is a fully dynamic architecture capable of utilizing pre-calculated results when they are available, or dynamically generating results from the raw information when necessary.
[0010] The Multidimensional OLAP (MOLAP) systems utilize a MDD or “cube” to provide OLAP analyses. The main premise of this architecture is that data must be stored multidimensionally to be accessed and viewed multidimensionally. Such non-relational MDD data structures typically can be queried by users to enable the users to “slice and dice” the aggregated data. As shown in FIG. 2 , such MOLAP systems have an Aggregation module which is responsible for all data storage, access, and retrieval processes, including data aggregation (i.e. pre-aggregation) in the MDDB, and an analytical processing and GUI module responsible for interfacing with a user to provide analytical analysis, query input, and reporting of query results to the user.
[0011] A more detailed description of the data warehouse and OLAP environment may be found in copending U.S. patent application Ser. No. 09/514,611 to R. Bakalash, G. Shaked, and J. Caspi, commonly assigned to HyperRoll Israel, Limited, incorporated by reference above in its entirety.
[0012] In a RDBMS, users view data stored in tables. By contrast, users of a non-relation database system can view other data structures, either instead of or in addition to the tables of the RDBMS system. FIG. 3A illustrates an exemplary table in an RDBMS; and FIGS. 3B and 3C illustrate operators (queries) on the table of FIG. 3A , and the result of such queries, respectively. The operators illustrated in FIGS. 3B and 3C are expressed as Structured Query Language (SQL) statements as is conventional in the art.
[0013] The choice of using a RDBMS as the data repository in information database systems naturally stems from the realities of SQL standardization, the wealth of RDBMS-related tools, and readily available expertise in RDBMS systems. However, the querying component of RDBMS technology suffers from performance and optimization problems stemming from the very nature of the relational data model. More specifically, during query processing, the relational data model requires a mechanism that locates the raw data elements that match the query. Moreover, to support queries that involve aggregation operations, such aggregation operations must be performed over the raw data elements that match the query. For large multi-dimensional databases, a naive implementation of these operations involves computational intensive table scans that leads to unacceptable query response times.
[0014] In order to better understand how the prior art has approached this problem, it will be helpful to briefly describe the relational database model. According to the relational database model, a relational database is represented by a logical schema and tables that implement the schema. The logical schema is represented by a set of templates that define one or more dimensions (entities) and attributes associated with a given dimension. The attributes associated with a given dimension includes one or more attributes that distinguish it from every other dimension in the database (a dimension identifier). Relationships amongst dimensions are formed by joining attributes. The data structure that represents the set of templates and relations of the logical schema is typically referred to as a catalog or dictionary. Note that the logical schema represents the relational organization of the database, but does not hold any fact data per se. This fact data is stored in tables that implement the logical schema.
[0015] Star schemas are frequently used to represent the logical structure of a relational database. The basic premise of star schemas is that information can be classified into two groups: facts and dimensions. Facts are the core data elements being analyzed. For example, units of individual item sold are facts, while dimensions are attributes about the facts. For example, dimensions are the product types purchased and the data purchase. Business questions against this schema are asked looking up specific facts (UNITS) through a set of dimensions (MARKETS, PRODUCTS, PERIOD). The central fact table is typically much larger than any of its dimension tables.
[0016] An exemplary star schema is illustrated in FIG. 4A for suppliers (the “Supplier” dimension) and parts (the “Parts” dimension) over time periods (the “Time-Period” dimension). It includes a central fact table “Supplied-Parts” that relates to multiple dimensions—the “Supplier”, “Parts” and “Time-Period” dimensions. FIG. 4B illustrates the tables used to implement the star schema of FIG. 4A . More specifically, these tables include a central fact table and a dimension table for each dimension in the logical schema of FIG. 4A . A given dimension table stores rows (instances) of the dimension defined in the logical schema. For the sake of description, FIG. 4B illustrates the dimension table for the “Time-Period” dimension only. Similar dimension tables for the “Supplier” and “Part” dimensions (not shown) are also included in such an implementation. Each row within the central fact table includes a multi-part key associated with a set of facts (in this example, a number representing a quantity). The multi-part key of a given row (values stored in the S#,P#, TP# fields as shown) points to rows (instances) stored in the dimension tables described above. A more detailed description of star schemas and the tables used to implement star schemas may be found in C.J. Date, “An Introduction to Database Systems,” Seventh Edition, Addison-Wesley, 2000, pp. 711–715, herein incorporated by reference in its entirety.
[0017] When processing a query, the tables that implement the schema are accessed to retrieve the facts that match the query. For example, in a star schema implementation as described above, the facts are retrieved from the central fact table and/or the dimension tables. Locating the facts that match a given query involves one or more join operations. Moreover, to support queries that involve aggregation operations, such aggregation operations must be performed over the facts that match the query. For large multi-dimensional databases, a naive implementation of these operations involves computational intensive table scans that typically leads to unacceptable query response times. Moreover, since the fact tables are pre-summarized and aggregated along business dimensions, these tables tend to be very large. This point becomes an important consideration of the performance issues associated with star schemas. A more detailed discussion of the performance issues (and proposed approaches that address such issues) related to joining and aggregation of star schema is now set forth.
[0018] The first performance issue arises from computationally intensive table scans that are performed by a naive implementation of data joining. Indexing schemes may be used to bypass these scans when performing joining operations. Such schemes include B-tree indexing, inverted list indexing and aggregate indexing. A more detailed description of such indexing schemes can be found in “The Art of Indexing”, Dynamic Information Systems Corporation, October 1999, available at http://www.disc.com/artindex.pdf. All of these indexing schemes replaces table scan operations (involved in locating the data elements that match a query) with one ore more index lookup operation. Inverted list indexing associates an index with a group of data elements, and stores (at a location identified by the index) a group of pointers to the associated data elements. During query processing, in the event that the query matches the index, the pointers stored in the index are used to retrieve the corresponding data elements pointed therefrom. Aggregation indexing integrates an aggregation index with an inverted list index to provide pointers to raw data elements that require aggregation, thereby providing for dynamic summarization of the raw data elements that match the user-submitted query.
[0019] These indexing schemes are intended to improve join operations by replacing table scan operations with one or more index lookup operation in order to locate the data elements that match a query. However, these indexing schemes suffer from various performance issues as follows:
-
- [0020] Since the tables in the star schema design typically contain the entire hierarchy of attributes (e.g. in a PERIOD dimension, this hierarchy could be day>week>month>quarter>year), a multipart key of day, week, month, quarter, year has to be created; thus, multiple meta-data definitions are required (one of each key component) to define a single relationship; this adds to the design complexity, and sluggishness in performance.
- [0021] Addition or deletion of levels in the hierarchy will require physical modification of the fact table, which is time consuming process that limits flexibility.
- [0022] Carrying all the segments of the compound dimensional key in the fact table increases the size of the index, thus impacting both performance and scalability.
[0023] Another performance issue arises from dimension tables that contain multiple hierarchies. In such cases, the dimensional table often includes a level of hierarchy indicator for every record. Every retrieval from fact table that stores details and aggregates must use the indicator to obtain the correct result, which impacts performance. The best alternative to using the level indicator is the snowflake schema. In this schema aggregate tables are created separately from the detail tables. In addition to the main fact tables, snowflake schema contains separate fact tables for each level of aggregation. Notably, the snowflake schema is even more complicated than a star schema, and often requires multiple SQL statements to get the results that are required.
[0024] Another performance issue arises from the pairwise join problem. Traditional RDBMS engines are not design for the rich set of complex queries that are issued against a star schema. The need to retrieve related information from several tables in a single query—“join processing” —is severely limited. Many RDBMSs can join only two tables at a time. If a complex join involves more than two tables, the RDBMS needs to break the query into a series of pairwise joins. Selecting the order of these joins has a dramatic performance impact. There are optimizers that spend a lot of CPU cycles to find the best order in which to execute those joins. Unfortunately, because the number of combinations to be evaluated grows exponentially with the number of tables being joined, the problem of selecting the best order of pairwise joins rarely can be solved in a reasonable amount of time.
[0025] Moreover, because the number of combinations is often too large, optimizers limit the selection on the basis of a criterion of directly related tables. In a star schema, the fact table is the only table directly related to most other tables, meaning that the fact table is a natural candidate for the first pairwise join. Unfortunately, the fact table is the very largest table in the query, so this strategy leads to selecting a pairwise join order that generates a very large intermediate result set, severely affecting query performance.
[0026] This is an optimization strategy, typically referred to as Cartesian Joins, that lessens the performance impact of the pairwise join problem by allowing joining of unrelated tables. The join to the fact table, which is the largest one, is deferred until the very end, thus reducing the size of intermediate result sets. In a join of two unrelated tables every combination of the two tables' rows is produced, a Cartesian product. Such a Cartesian product improves query performance. However, this strategy is viable only if the Cartesian product of dimension rows selected is much smaller than the number of rows in the fact table. The multiplicative nature of the Cartesian join makes the optimization helpful only for relatively small databases.
[0027] In addition, systems that exploit hardware and software parallelism have been developed that lessens the performance issues set forth above. Parallelism can help reduce the execution time of a single query (speed-up), or handle additional work without degrading execution time (scale-up).). For example, Red Brick™ has developed STARjoin™ technology that provides high speed, parallelizable multi-table joins in a single pass, thus allowing more than two tables can be joined in a single operation. The core technology is an innovative approach to indexing that accelerates multiple joins. Unfortunately, parallelism can only reduce, not eliminate, the performance degradation issues related to the star schema.
[0028] One of the most fundamental principles of the multidimensional database is the idea of aggregation. The most common aggregation is called a roll-up aggregation. This type is relatively easy to compute: e.g. taking daily sales totals and rolling them up into a monthly sales table. The more difficult are analytical calculations, the aggregation of Boolean and comparative operators. However these are also considered as a subset of aggregation.
[0029] In a star schema, the results of aggregation are summary tables. Typically, summary tables are generated by database administrators who attempt to anticipate the data aggregations that the users will request, and then pre-build such tables. In such systems, when processing a user-generated query that involves aggregation operations, the pre-built aggregated data that matches the query is retrieved from the summary tables (if such data exists). FIGS. 5A and 5B illustrate a multi-dimensional relational database using a star schema and summary tables. In this example, the summary tables are generated over the “time” dimension storing aggregated data for “month”, “quarter” and “year” time periods as shown in FIG. 5B . Summary tables are in essence additional fact tables, of higher levels. They are attached to the basic fact table creating a snowflake extension of the star schema. There are hierarchies among summary tables because users at different levels of management require different levels of summarization. Choosing the level of aggregation is accomplished via the “drill-down” feature.
[0030] Summary tables containing pre-aggregated results typically provide for improved query response time with respect to on-the-fly aggregation. However, summary tables suffer from some disadvantages:
-
- [0031] summary tables require that database administrators anticipate the data aggregation operations that users will require; this is a difficult task in large multi-dimensional databases (for example, in data warehouses and data mining systems), where users always need to query in new ways looking for new information and patterns.
- [0032] summary tables do not provide a mechanism that allows efficient drill down to view the raw data that makes up the summary table—typically a table scan of one or more large tables is required.
- [0033] querying is delayed until pre-aggregation is completed.
- [0034] there is a heavy time overhead because the vast majority of the generated information remains unvisited.
- [0035] there is a need to synchronize the summary tables before the use.
- [0036] the degree of viable parallelism is limited because the subsequent levels of summary tables must be performed in pipeline, due to their hierarchies.
- [0037] for very large databases, this option is not valid because of time and storage space.
Note that it is common to utilize both pre-aggregated results and on-the-fly aggregation in support aggregation. In these system, partial pre-aggregation of the facts results in a small set of summary tables. On-the-fly aggregation is used in the case the required aggregated data does not exist in the summary tables.
[0038] Note that in the event that the aggregated data does not exist in the summary tables, table join operations and aggregation operations are performed over the raw facts in order to generate such aggregated data. This is typically referred to as on-the-fly aggregation. In such instances, aggregation indexing is used to mitigate the performance of multiple data joins associated with dynamic aggregation of the raw data. Thus, in large multi-dimensional databases, such dynamic aggregation may lead to unacceptable query response times.
[0039] In view of the problems associated with joining and aggregation within RDBMS, prior art ROLAP systems have suffered from essentially the same shortcomings and drawbacks of their underlying RDBMS.
[0040] While prior art MOLAP systems provide for improved access time to aggregated data within their underlying MDD structures, and have performance advantages when carrying out joining and aggregations operations, prior art MOLAP architectures have suffered from a number of shortcomings and drawbacks which Applicants have detailed in their copending U.S. application Ser. Nos. 09/368,241 and 09/514,611 incorporated herein by reference.
[0041] In summary, such shortcomings and drawbacks stem from the fact that there is unidirectional data flow from the RDBMS to the MOLAP system. More specifically, atomic (raw) data is moved, in a single transfer, to the MOLAP system for aggregation, analysis and querying. Importantly, the aggregation results are external to the RDBMS. Thus, users of the RDBMS cannot directly view these results. Such results are accessible only from the MOLAP system. Because the MDD query processing logic in prior art MOLAP systems is separate from that of the RDBMS, users must procure rights to access to the MOLAP system and be instructed (and be careful to conform to such instructions) to access the MDD (or the RDBMS) under certain conditions. Such requirements can present security issues, highly undesirable for system administration. Satisfying such requirements is a costly and logistically cumbersome process. As a result, the widespread applicability of MOLAP systems has been limited.
[0042] Thus, there is a great need in the art for an improved mechanism for joining and aggregating data elements within a relational database management system, and for integrating the improved relational database management system into informational database systems (including the data warehouse and OLAP domains), while avoiding the shortcomings and drawbacks of prior art systems and methodologies.
Summary and Objects of Present Invention
[0043] Accordingly, it is an object of the present invention to provide an improved method of and system for joining and aggregating data elements integrated within a relational database management system (RDBMS) using a non-relational multi-dimensional data structure (MDD), achieving a significant increase in system performance (e.g. deceased access/search time), user flexibility and ease of use.
[0044] Another object of the present invention is to provide such an RDBMS wherein its integrated data aggregation module supports high-performance aggregation (i.e. data roll-up) processes to maximize query performance of large data volumes.
[0045] Another object of the present invention is to provide such an RDBMS system, wherein its integrated data aggregation (i.e. roll-up) module speeds up the aggregation process by orders of magnitude, enabling larger database analysis by lowering the aggregation times.
[0046] Another object of the present invention is to provide such a novel RDBMS system for use in OLAP operations.
[0047] Another object of the present invention is to provide a novel RDBMS system having an integrated aggregation module that carries out an novel rollup (i.e. down-up) and spread down (i.e. top-down) aggregation algorithms.
[0048] Another object of the present invention is to provide a novel RDBMS system having an integrated aggregation module that carries out full pre-aggregation and/or “on-the-fly” aggregation processes.
[0049] Another object of the present invention is to provide a novel RDBMS system having an integrated aggregation module which is capable of supporting a MDD having a multi-hierarchy dimensionality.
[0050] These and other object of the present invention will become apparent hereinafter and in the Claims to Invention set forth herein.
Brief Description of the Drawings
[0051] In order to more fully appreciate the objects of the present invention, the following Detailed Description of the Illustrative Embodiments should be read in conjunction with the accompanying Drawings, wherein:
[0052] FIG. 1 is a schematic representation of a prior art information database system, wherein the present invention may be embodied.
[0053] FIG. 2 is a schematic representation of the prior art data warehouse and OLAP system, wherein the present invention may be embodied.
[0054] FIGS. 3A–3C are schematic representations of exemplary tables employed in a prior art Relational Database Management System (RDBMS); FIGS. 3B and 3C illustrate operators (queries) on the table of FIG. 3A , and the result of such queries, respectively.
[0055] FIG. 4A is a schematic representation of an exemplary dimensional schema (star schema) of a relational database.
[0056] FIG. 4B is a schematic representation of tables used to implement the schema shown in FIG. 4A .
[0057] FIG. 5A is a schematic representation of an exemplary multidimensional schema (star schema).
[0058] FIG. 5B is a schematic representation of tables used to implement the schema of FIG. 5A , including summary tables storing results of aggregation operations performed on the facts of the central fact table along the time-period dimension, in accordance with conventional teachings.
[0059] FIG. 6A is a schematic representation of a generalized embodiment of an RDBMS of the present invention comprising a relational database having an integrated multidimensional (MDD) aggregation module supporting queries from a plurality of clients, wherein the aggregation engine performs aggregation functions (e.g. summation of numbers, as well as other mathematical operations, such as multiplication, subtraction, division etc.) and non-relational multi-dimensional data storage functions.
[0060] FIG. 6B is a schematic block diagram of the MDD aggregation module of the illustrative embodiment of the present invention shown in FIG. 6A .
[0061] FIGS. 6C1 and 6C2, taken together, set forth a flow chart representation of the primary operations carried out within the RDBMS of the present invention when performing data aggregation and related support operations, including the servicing of user-submitted (e.g. natural language) queries made on such aggregated database of the present invention.
[0062] FIG. 6D is a flow chart representation of the primary operations carried out by the (DB) request serving mechanism within the MDD control module shown in FIG. 6B .
[0063] FIG. 6E is a schematic representation of the view mechanism of the RDBMS that enables users to query on the aggregated data generated and/or stored in the MDD Aggregation module according to the present invention.
[0064] FIG. 6F is a schematic representation of the trigger mechanism of the RDBMS that enables users to query on the aggregated data generated and/or stored in the MDD Aggregation module according to the present invention.
[0065] FIG. 7A shows a separate-platform implementation of the RDBMS system of the illustrative embodiment shown in FIG. 6A , wherein the query handling, fact table(s) and dictionary of the RDBMS resides on a separate hardware platform and/or OS system from that used to run the MDD Aggregation Module of the present invention.
[0066] FIG. 7B shows a common-platform implementation of the RDBMS system of the illustrative embodiment shown in FIG. A, wherein the query handling, fact table(s) and dictionary of the RDBMS shares the same hardware platform and operating system (OS) that used to run the MDD Aggregation Module of the present invention.
[0067] FIG. 8A is a data table setting forth information representative of performance benchmarks obtained by the shared-platform type implementation of the MDD Aggregation Module of the illustrative embodiment serving the conventional OLAP server (i.e. Oracle EXPRESS Server, wherein the common hardware/software platform is realized using a Pentium II 450 Mhz, 1 GB RAM, 18 GB Disk, running the Microsoft NT operating system (OS);
[0068] FIG. 9A is a schematic representation of the first stage in the method of segmented aggregation according to the principles of the present invention, showing initial aggregation along the 1st dimension.
[0069] FIG. 9B is a schematic representation of the next stage in the method of segmented aggregation according to the principles of the present invention, showing that any segment along dimension 1, such as the shown slice, can be separately aggregated along the remaining dimensions, 2 and 3, and that in general, for an N dimensional system, the second stage involves aggregation in N−1 dimensions. The principle of segmentation can be applied on the first stage as well, however, only a large enough data will justify such a sliced procedure in the first dimension. Actually, it is possible to consider each segment as an N−1 cube, enabling recursive computation.
[0070] FIG. 9C1 is a schematic representation of the Query Directed Roll-up (QDR) aggregation method/procedure of the present invention, showing data aggregation starting from existing basic data or previously aggregated data in the first dimension (D1), and such aggregated data being utilized as a basis for QDR aggregation along the second dimension (D2).
[0071] FIG. 9C2 is a schematic representation of the Query Directed Roll-up (QDR) aggregation method/procedure of the present invention, showing initial data aggregation starting from existing previously aggregated data in the second third (D3), and continuing along the third dimension (D3), and thereafter continuing aggregation along the second dimension (D2).
[0072] FIG. 10A is a schematic representation of the “slice-storage” method of storing sparse data in the disk storage devices of the MDDB of FIG. 6B in accordance with the principles of the present invention, based on an ascending-ordered index along aggregation direction, enabling fast retrieval of data.
[0073] FIG. 10B is a schematic representation of the data organization of data files and the directory file used in the storage of the MDDB of FIG. 6B , and the method of searching for a queried data point therein using a simple binary search technique due to the data files ascending order;
[0074] FIG. 11A is a schematic representation of three exemplary multi-hierarchical data structures for storage of data within the MDDB of FIG. 6B , having three levels of hierarchy, wherein the first level representative of base data is composed of items A,B,F, and G, the second level is composed of items C,E,H and I, and the third level is composed of a single item D, which is common to all three hierarchical structures.
[0075] FIG. 11B is a schematic representation of an optimized multi-hierarchical data structure merged from all three hierarchies of FIG. 11 A, in accordance with the principles of the present invention.
[0076] FIG. 12 is a schematic representation showing the levels of operations performed by the stand-alone Aggregation Server of FIG. 6B , summarizing the different enabling components for carrying out the method of segmented aggregation in accordance with the principles of the present invention.
[0077] FIG. 13 is a schematic representation of the RDBMS of the present invention shown as a component of a central data warehouse, serving the data storage and aggregation needs of a ROLAP system (or other OLAP system).
Detailed Description of the Preferred Embodiments of the Present Invention
[0078] Referring now to FIG. 6 through FIG. 13 , the preferred embodiments of the method and system of the present invention will be now described in great detail herein below.
[0079] Through this document, the term “aggregation” and “pre-aggregation” shall be understood to mean the process of summation of numbers, as well as other mathematical operations, such as multiplication, subtraction, division etc. It shall be understood that pre-aggregation operations occur asynchronously with respect to the traditional query processing operations. Moreover, the term “atomic data” shall be understood to refer to the lowest level of data granularity required for effective decision making. In the case of a retail merchandising manager, atomic data may refer to information by store, by day, and by item. For a banker, atomic data may be information by account, by transaction, and by branch.
[0080] In general, the improved RDBMS system of the present invention excels in performing two distinct functions, namely: the aggregation of data; and the handling of the resulting data for “on demand” client use. Moreover, because of improved data aggregation capabilities, the RDBMS of the present invention can be employed in a wide range of applications, including Data Warehouses supporting OLAP systems and the like. For purposes of illustration, initial focus will be accorded to the RDMS of the present invention.
[0081] FIG. 6A illustrates the primary components of an illustrative embodiment of the RDBMS of the present invention, namely: support mechanisms including a query interface and query handler, a relational data store including one or more fact tables and a meta-data store for storing a dictionary (catalogue), and an MDD Aggregation Module that stores atomic data and aggregated data in a non-relational MDD. It should be noted that the RDBMS typically includes additional components (not shown) that are not relevant to the present invention. The query interface and query handler service user-submitted queries (in the preferred embodiment, SQL query statements) forwarded, for example, from a client machine over a network as shown. The query handler, fact table and meta-data store communicate to the MDD Aggregation Module. Importantly, the query handler and integrated MDD Aggregation Module operates to provide for dramatically improved query response times for data aggregation operations and drill-downs. Moreover, it is an object of the present invention is to make user-querying of the non-relational MDDB no different than querying a relational table of the RDBMS, in a manner that minimizes the delays associated with queries that involve aggregation or drill down operations. This object is enabled by providing the novel RDBMS system and integrated aggregation mechanism of the present invention.
[0082] FIG. 6B shows the primary components of an illustrative embodiment of the MDD Aggregation Module of FIG. 6A , namely: a base data loader for loading the directory and fact table(s) of the RDBMS; an aggregation engine for receiving dimension data and fact data from the base loader, a multi-dimensional database (MDDB); a MDDB handler, an SQL handler that operates cooperatively with the query handler of the RDBMS to provide users with query access to the MDD Aggregation Module, and a control module for managing the operation of the components of the MDD aggregation module. The base data loader may load the directory and fact tables over a standard interface (such as OLDB, OLE-DB, ODBC, SQL, API, JDBC, etc.). In this case, the RDBMS and base data loader include components that provide communication of such data over these standard interfaces. Such interface components are well known in the art. For example, such interface components are readily available from Attunity Corporation, http://www.attunity.com.
[0083] During operation, the base data originates from the fact table(s) of the RDBMS. The core data aggregation operations are performed by the Aggregation Engine; a Multidimensional Data Handler; and a Multidimensional Data Storage. The results of data aggregation are efficiently stored in a multidimensional data storage (MDDB), by the Data Handler. The SQL handler of the MDD Aggregation module services user-submitted queries (in the preferred embodiment, SQL query statements) forwarded from the query handler of the RDBMS. The SQL handler of the MDD Aggregation module may communicate with the query handler of the RDBMS over a standard interface (such as OLDB, OLE-DB, ODBC, SQL, API, JDBC, etc.). In this case, the support mechanisms of the RDBMS and SQL handler include components that provide communication of such data over these standard interfaces. Such interface components are well known in the art. Aggregation (or drill down results) are retrieved on demand and returned to the user.
[0084] Typically, a user interacts with a client machine (for example, using a web-enabled browser) to generate a natural language query, that is communicated to the query interface of the RDBMS, for example over a network as shown. The query interface disintegrates the query, via parsing, into a series of requests (in the preferred embodiment, SQL statements) that are communicated to the query handler of the RDBMS. It should be noted that the functions of the query interface may be implemented in a module that is not part of the RDBMS (for example, in the client machine). The query handler of the RDBMS forwards requests that involve data stored in the MDD of the MDD Aggregation module to the SQL handler of the MDD Aggregation module for servicing. Each request specifies a set of n-dimensions. The SQL handler of the MDD Aggregation Module extracts this set of dimensions and operates cooperatively with the MDD handler to address the MDDB using the set of dimensions, retrieve the addressed data from the MDDB, and return the results to the user via the query handler of the RDBMS.
[0085] FIG. 6C(i) and 6C(ii) is FIGS. 6C1 and 6C2 set forth a flow chart illustrating the operations of an illustrative RDBMS of the present invention. In step 601, the base data loader of the MDD Aggregation Module loads the dictionary (or catalog) from the meta-data store in the RDBMS. In performing this function, the base data loader may utilize an adapter (interface) that maps the data types of the dictionary of the RDBMS (or that maps a standard data type used to represent the dictionary of the RDBMS) into the data types used in the MDD aggregation module. In addition, the base data loader extracts the dimensions from the dictionary and forwards the dimensions to the aggregation engine of the MDD Aggregation Module.
[0086] In step 603, the base data loader loads the fact table(s) from the RDBMS. In performing this function, the base data loader may utilize an adapter (interface) that maps the data types of the fact table(s) of the RDBMS (or that maps a standard data type used to represent the fact table(s) of the RDBMS) into the data types used in the MDD Aggregation Module. In addition, the base data loader extracts the atomic data from the fact table, and forwards the atomic data to the aggregation engine.
[0087] In step 605, the aggregation engine rolls-up (aggregates) the atomic data (provided by the base data loader in step 603) along at least one of the dimensions and operates cooperatively with the MDD handler to store the resultant aggregated data in the MDD database. A more detailed description of exemplary aggregation operations according to a preferred embodiment of the present invention is set forth below with respect to the QDR process of FIGS. 9A–9C .
[0088] In step 607, a reference is defined that provides users with the ability to query the data generated by the MDD Aggregation Module and/or stored in the MDDB of the MDD Aggregation Module. This reference is preferably defined using the Create View SQL statement, which allows the user to: i) define a table name (TN) associated with the MDD database stored in the MDD Aggregation Module, and ii) define a link used to route SQL statements on the table TN to the MDD Aggregation Module. In this embodiment, the view mechanism of the RDBMS enables reference and linking to the data stored in the MDDB of the MDD Aggregation Engine as illustrated in FIG. 6(E) . A more detailed description of the view mechanism and the Create View SQL statement may be found in C.J. Date, “An Introduction to Database Systems,” Addison-Wesley, Seventh Edition, 2000, pp. 289–326, herein incorporated by reference in its entirety. Thus, the view mechanism enables the query handler of the RDBMS system to forward any SQL query on table TN to the MDD aggregation module via the associated link. In an alternative embodiment, a direct mechanism (e.g., NA trigger mechanism) may be used to enable the RDBMS system to reference and link to the data generated by the MDD Aggregation Module and/or stored in the MDDB of the MDD Aggregation Engine as illustrated in FIG. 6F . A more detailed description of trigger mechanisms and methods may be found in C.J. Date, “An Introduction to Database Systems,” Addison-Wesley, Seventh Edition, 2000, pp. 250, 266, herein incorporated by reference in its entirety.
[0089] In step 609, a user interacts with a client machine to generate a query, and the query is communicated to the query interface. The query interface generate one or more SQL statements on the reference defined in step 607 (this reference refers to the data stored in the MDDB of the MDD Aggregation Module), and forwards the SQL statement(s) to the query handler of the RDBMS.
[0090] In step 611, the query handler receives the SQL statement(s); and optionally transforms such SQL statement(s) to optimize the SQL statement (s) for more efficient query handling. Such transformations are well known in the art. For example, see Kimball, “Aggregation Navigation With (Almost) No MetaData”, DBMS Data Warehouse Supplement, August 1996, available at http://www.dbmsmag.com/9608d54.html.
[0091] In step 613: the query handler determines whether the received SQL statement(s) [or transformed SQL statement(s)] is on the reference generated in step 607. If so, operation continues to step 615; otherwise normal query handling operations continue is step 625
[0092] In step 615, the received SQL statement(s) [or transformed SQL statement(s)] is routed to the MDD aggregation engine for processing in step 617 using the link for the reference as described above with respect to step 607.
[0093] In step 617, the SQL statement(s) is received by the SQL handler of the MDD Aggregation Module, wherein a set of one or more N-dimensional coordinates are extracted from the SQL statement. In performing this function, SQL handler may utilize an adapter (interface) that maps the data types of the SQL statement issued by query handler of the RDBMS (or that maps a standard data type used to represent the SQL statement issued by query handler of the RDBMS) into the data types used in the MDD aggregation module.
[0094] In step 619, the set of N-dimensional coordinates extracted in step 617 are used by the MDD handler to address the MDDB and retrieve the corresponding data from the MDDB.
[0095] Finally, in step 621, the retrieved data is returned to the user via the RDBMS (for example, by forwarding the retrieved data to the SQL handler, which returns the retrieved data to the query handler of the RDBMS system, which returns the results of the user-submitted query to the user via the client machine), and the operation ends.
[0096] It should be noted that the facts (base data), as it arrives from RDBMS, may be analyzed and reordered to optimize hierarchy handling, according to the unique method of the present invention, as described later with reference to FIGS. 11A and 11B .
[0097] Moreover, the MDD control module of the MDD Aggregation Module preferably administers the aggregation process according to the method illustrated in FIGS. 9A and 9B . Thus, in accordance with the principles of the present invention, data aggregation within the RDBMS can be carried out either as a complete pre-aggregation process, where the base data is fully aggregated before commencing querying, or as a query directed roll-up (QDR) process, where querying is allowed at any stage of aggregation using the “on-the-fly” data aggregation process of the present invention. The QDR process will be described hereinafter in greater detail with reference to FIG. 9C . The response to a request (i.e. a basic component of a client query) requiring “on-the-fly” data aggregation, or requiring access to pre-aggregated result data via the MDD handler is provided by a query/request serving mechanism of the present invention within the MDD control module, the primary operations of which are illustrated in the flow chart of FIG. 6D . The function of the MDD Handler is to handle multidimensional data in the storage(s) module in a very efficient way, according to the novel method of the present invention, which will be described in detail hereinafter with reference to FIGS. 10A and 10B .
[0098] The SQL handling mechanism shown in FIG. 6D is controlled by the MDD control module. Requests are queued and served one by one. If the required data is already pre-calculated, then it is retrieved by the MDD handler and returned to the client. Otherwise, the required data is calculated “on-the-fly” by the aggregation engine, and the result moved out to the client, while simultaneously stored by the MDD handler, shown in FIGS. 6C1 and 6C2.
[0099] FIGS. 7A and 7B outline two different implementations of the RDBMS system of the present invention. In both implementations, the query handler of the RDBMS system supplies aggregated results retrieved from the MDD to a client.
[0100] FIG. 7A shows a separate-platform implementation of the RDBMS system of the illustrative embodiment shown in FIG. 6A , wherein the support mechanisms (query handling) and relational data store (fact table(s) and dictionary) of the RDBMS resides on a separate hardware platform and/or OS system from that used to run the MDD Aggregation Module. In this type of implementation, it is even possible to run parts of the RDBMS system and the MDD Aggregation Module on different-type operating systems (e.g. NT, Unix, MAC OS).
[0101] FIG. 7B shows a common-platform implementation of the RDBMS system of the illustrative embodiment shown in FIG. A, wherein the support mechanisms (query handling) and the relational data store (fact table(s) and dictionary) of the RDBMS shares the same hardware platform and operating system (OS) that used to run the MDD Aggregation Module.
[0102] FIG. 8A shows a table setting forth the benchmark results of the MDD aggregation module, in accordance with the principles of the present invention. The platform and OS is realized using a Pentium II 450 Mhz, 1 GB RAM, 18 GB Disk, running the Microsoft NT operating system. The six (6) data sets shown in the table differ in number of dimensions, number of hierarchies, measure of sparcity and data size. A comparison with ORACLE Express, a major OLAP server, is made. It is evident that the MDD aggregation module of the present invention outperforms currently leading aggregation technology by more than an order of magnitude.
[0103] Preferably, the MDD aggregation module of the RDBMS of the present invention supports a segmented data aggregation method as described in FIGS. 9A through 9C2. These figures outline a simplified setting of three dimensions only; however, the following analysis applies to any number of dimensions as well.
[0104] The data is being divided into autonomic segments to minimize the amount of simultaneously handled data. The initial aggregation is practiced on a single dimension only, while later on the aggregation process involves all other dimensions.
[0105] At the first stage of the aggregation method, an aggregation is performed along dimension 1. The first stage can be performed on more than one dimension. As shown in FIG. 9A , the space of the base data is expanded by the aggregation process.
[0106] In the next stage shown in FIG. 9B , any segment along dimension 1, such as the shown slice, can be separately aggregated along the remaining dimensions, 2 and 3. In general, for an N dimensional system, the second stage involves aggregation in N−1 dimensions.
[0107] The principle of data segmentation can be applied on the first stage as well. However, only a large enough data set will justify such a sliced procedure in the first dimension. Actually, it is possible to consider each segment as an N−1 cube, enabling recursive computation.
[0108] It is imperative to get aggregation results of a specific slice before the entire aggregation is completed, or alternatively, to have the roll-up done in a particular sequence. This novel feature of the aggregation method of the present invention is that it allows the querying to begin, even before the regular aggregation process is accomplished, and still having fast response. Moreover, in relational OLAP and other systems requiring only partial aggregations, the QDR process dramatically speeds up the query response.
[0109] The QDR process is made feasible by the slice-oriented roll-up method of the present invention. After aggregating the first dimension(s), the multidimensional space is composed of independent multidimensional cubes (slices). These cubes can be processed in any arbitrary sequence.
[0110] Consequently the aggregation process of the present invention can be monitored by means of files, shared memory sockets, or queues to statically or dynamically set the roll-up order.
[0111] In order to satisfy a single query , before the required aggregation result has been prepared, the QDR process of the present invention involves performing a fast on-the-fly aggregation (roll-up) involving only a thin slice of the multidimensional data.
[0112] FIG. 9C1 shows a slice required for building-up a roll-up result of the 2nd dimension. In case 1, as shown, the aggregation starts from an existing data, either basic or previously aggregated in the first dimension. This data is utilized as a basis for QDR aggregation along the second dimension. In case 2, due to lack of previous data, a QDR involves an initial slice aggregation along dimension 3, and thereafter aggregation along the 2nd dimension.
[0113] FIG. 9C2 shows two corresponding QDR cases for gaining results in the 3d dimension. Cases 1 and 2 differ in the amount of initial aggregation required in 2nd dimension.
[0114] FIG. 10A illustrates the “Slice-Storage” method of storing sparse data on storage disks. In general, this data storage method is based on the principle that an ascending-ordered index along aggregation direction, enables fast retrieval of data. FIG. 10A illustrates a unit-wide slice of the multidimensional cube of data. Since the data is sparse, only few non-NA data points exist. These points are indexed as follows. The Data File consists of data records, in which each n-1 dimensional slice is being stored, in a separate record. These records have a varying length, according to the amount of non-NA stored points. For each registered point in the record, INDk stands for an index in a n-dimensional cube, and Data stands for the value of a given point in the cube.
[0115] FIG. 10B illustrates a novel method for randomly searching for a queried data point in the MDD of the RDBMS of the present invention by using a novel technique of organizing data files and the directory file used in the storage of the MDD, so that a simple binary search technique can then be employed within the aggregation module of the RDMB. According to this method, a metafile termed DIR File, keeps pointers to Data Files as well as additional parameters such as the start and end addresses of data record (IND0, INDn), its location within the Data File, record size (n), file's physical address on disk (D_Path), and auxiliary information on the record (Flags).
[0116] A search for a queried data point is then performed by an access to the DIR file. The search along the file can be made using a simple binary search due to file's ascending order. When the record is found, it is then loaded into main memory to search for the required point, characterized by its index IND k. The attached Data field represents the queried value. In case the exact index is not found, it means that the point is a NA.
[0117] FIGS. 11A and 11B illustrate a novel method performed by the MDD aggregation module of the RDBMS of the present invention for pre-processing data such that multi-hierarchies in multi-hierarchical structures are optimally merged. According to the devised method, the inner order of hierarchies within a dimension is optimized, to achieve efficient data handling for summations and other mathematical formulas (termed in general “Aggregation”). The order of hierarchy is defined externally. It is brought from a data source to the stand-alone aggregation engine, as a descriptor of data, before the data itself. In the illustrative embodiment, the method assumes hierarchical relations of the data, as shown in FIG. 11A . The way data items are ordered in the memory space of the Aggregation Server, with regard to the hierarchy, has a significant impact on its data handling efficiency.
[0118] Notably, when using prior art techniques, multiple handling of data elements, which occurs when a data element is accessed more than once during aggregation process, has been hitherto unavoidable when the main concern is to effectively handle the sparse data. The data structures used in prior art data handling methods have been designed for fast access to a available data (not NA data). According to prior art techniques, each access is associated with a timely search and retrieval in the data structure. For the massive amount of data typically accessed from a Data Warehouse in an OLAP application, such multiple handling of data elements has significantly degraded the efficiency of prior art data aggregation processes. When using prior art data handling techniques, the data element D shown in FIG. 11A must be accessed three times, causing poor aggregation performance.
[0119] In accordance with the present invention, the MDD aggregation module of the RDBMS performs the loading of base data and the aggregation and storage of the aggregated data in a way that limits the access of to a singular occurrence, as opposed to multiple occurrences as taught by prior art methods. According to the present invention, elements of base data and their aggregated results are contiguously stored in a way that each element will be accessed only once. This particular order allows a forward-only handling, never backward. Once a base data element is stored, or aggregated result is generated and stored, it is never to be retrieved again for further aggregation. As a result the storage access is minimized. This way of singular handling greatly elevates the aggregation efficiency of large data bases. The data element D, as any other element, is accessed and handled only once.
[0120] FIG. 11A shows an example of a multi-hierarchical database structure having 3 hierarchies. As shown, the base data includes the items A,B,F, and G., The second level is composed of items C,E,H and I. The third level has a single item D, which is common to all three hierarchical structures. In accordance with the method of the present invention, a minimal computing path is always taken. For example, according to the method of the present invention, item D will be calculated as part of structure 1, requiring two mathematical operations only, rather than as in structure 3, which would need four mathematical operations. FIG. 11B depicts an optimized structure merged from all three hierarchies.
[0121] FIG. 12 summarizes the different enabling components for segmented aggregation. The minimized operations in handling multi-hierarchies need analysis of the base data. It greatly optimizes data handling and contribute to aggregation speed. Based on this technology loading and indexing operations become very efficient, minimizing memory and storage access, and speeding up storing and retrieval operations. On top of all the enabling technologies is the segmented aggregation technique, not just outperforming by orders of magnitude the prior-art aggregation algorithms, but also enabling the unique QDR which waves out the need of waiting for full pre-aggregation.
[0122] FIG. 13 shows the improved RDBMS of the present invention as a component of a data warehouse, serving the data storage and aggregation needs of a ROLAP system (or other OLAP systems alike). Importantly, the improved RDBMS of the present invention provides flexible, high-performance access and analysis of large volumes of complex and interrelated data. Moreover, the improved Data Warehouse RDBMS of the present invention can simultaneously serve many different kinds of clients (e.g. data mart, OLAP, URL) and has the power of delivering an enterprise-wide data storage and aggregation in a cost-effective way. This kind of system eliminates redundancy over the group of clients, delivering scalability and flexibility. Moreover, the improved RDBMS of the present invention can be used as the data store component of in any informational database system as described above, including data analysis programs such as spread-sheet modeling programs, serving the data storage and aggregation needs of such systems.
Functional Advantages Gained by the Improved RDBMS of the Present Invention
[0123] The features of the RDBMS of the present invention, provides for dramatically improved response time in handling queries issued to the RDBMS that involve aggregation, thus enabling enterprise-wide centralized aggregation. Moreover, in the preferred embodiment of the present invention, users can query the aggregated data in an manner no different than traditional queries on an RDBMS.
[0124] The method of Segmented Aggregation employed by the novel RDBMS of the present invention provides flexibility, scalability, the capability of Query Directed Aggregation, and speed improvement.
[0125] Moreover, the method of Query Directed Aggregation (QDR) employed by the novel RDBMS of the present invention minimizes the data handling operations in multi-hierarchy data structures, eliminates the need to wait for full aggregation to be complete, and provides for build-up of aggregated data required for full aggregation.
[0126] It is understood that the System and Method of the illustrative embodiments described herein above may be modified in a variety of ways which will become readily apparent to those skilled in the art of having the benefit of the novel teachings disclosed herein. All such modifications and variations of the illustrative embodiments thereof shall be deemed to be within the scope and spirit of the present invention as defined by the Claims to Invention appended hereto.
Claims
What is claimed is:
1. An aggregation server adapted to handle large data volumes and provide rapid query response with sparse data having a tendency to experience data explosion as the number of dimensions increases, said aggregation server comprising:
an aggregation module adapted to aggregate sparse data, said aggregation module operatively coupleable to a relational data store, said aggregation module including a base data loader to load base data from said relational data store, an aggregation engine to aggregate said base data, and a non-relational multi-dimensional data store for storing base data and aggregated data; and
a controller for servicing query statements at any stage of aggregation, said controller in response to determining that data required to service a given query statement has not been pre-aggregated directs said aggregation engine to perform an aggregation on-the-fly to service the given query statement utilizing a query directed rollup in which a multi-dimensional data space is organized as independent segments to permit different rollup orders to service the given query statement, said controller selecting a rollup order based on the given query statement and any partially pre-aggregated data present in said non-relational multi-dimensional data store to service the given query statement.
2. The aggregation server of claim 1, wherein said aggregation server stores data aggregated on-the-fly to build up a store of aggregated data for servicing queries until at least a partial pre-aggregation is completed.
3. The aggregation server of claim 1, wherein said aggregation server selects a rollup order to minimize a processing delay associated with aggregating data on-the-fly to service the given query statement.
4. The aggregation server of claim 1, wherein said aggregation server selects a rollup order to reduce the amount of simultaneously handled data required to aggregate data on-the-fly to service a given query statement.
5. The aggregation server of claim 1, further comprising hierarchy logic, said hierarchy logic resolving hierarchies to reduce data handling performed on sparse data.
6. The aggregation server of claim 1, further comprising a data directory adapted to index sparse data associated with said independent segments for rapid retrieval.
7. The aggregation server of claim 1, wherein after an initial aggregation step said multi-dimensional data space is organized with said independent segments comprising independent multi-dimensional cubes.
8. The aggregation server of claim 1, wherein said aggregation server has a mode of operation in which data is aggregated on-the-fly after a partial pre-aggregation of data is performed.
9. The aggregation server of claim 1, wherein said aggregation server is adapted to perform an aggregation on-the-fly utilizing independent segments corresponding to slices of the multidimensional data that are thin compared with the entire multidimensional data such that data handling required to aggregate data on-the-fly for a given query statement is reduced.
10. The aggregation server of claim 1, wherein said controller is integrated within said aggregation module.
11. The aggregation server of claim 10, wherein said aggregation module comprises:
a first data communication interface for said aggregation module to interface with said relational data store and receive said base data loaded into said aggregation module from said relational data store; and
a second data communication interface for said aggregation module to interface with one or more clients having a query interface for converting queries from end-users into said query statements.
12. The aggregation server of claim 11, wherein said first and second data communication interfaces allow said aggregation module to be installed into a software-based computing environment in a cartridge-like manner.
13. The aggregation server of claim 1, wherein said aggregation module comprises:
a first data communication interface for said aggregation module to interface with said relational data store and receive said base data loaded into said aggregation module from said relational data store; and
a second data communication interface for said aggregation module to interface with one or more clients having a query interface for converting queries from end-users into said query statements.
14. An aggregation server adapted to handle large data volumes and provide rapid query response for sparse data having a tendency to experience data explosion as the number of dimensions increases, said aggregation server comprising:
an aggregation module adapted to aggregate sparse data, said aggregation module operatively coupleable to a relational data store, said aggregation module including a base data loader to load base data from said relational data store, an aggregation engine to aggregate said base data, and a non-relational multi-dimensional data store for storing base data and aggregated data; and
a controller for servicing query statements at any stage of aggregation, said controller in response to determining that data required to service a given query statement has not been pre-aggregated directs said aggregation engine to perform an aggregation on-the-fly to service the given query statement utilizing a query directed rollup in which a multi-dimensional data space is organized as independent segments to permit different rollup orders to service the given query statement, said controller selecting a rollup order based on the given query statement and any partially pre-aggregated data present in said non-relational multi-dimensional data store to service the given query statement;
wherein each of said independent segments represents only a comparatively thin slice of the total multi-dimensional data space to reduce the amount of data that must be handled to perform an aggregation in selected dimensions with respect to an individual segment.
15. The aggregation server of claim 14, wherein said aggregation server selects a rollup order to minimize a processing delay associated with aggregating data on-the-fly to service the given query statement.
16. The aggregation server of claim 14, wherein said aggregation server selects a rollup order to reduce the amount of simultaneously handled data required to aggregate data on-the-fly to service a given query statement.
17. The aggregation server of claim 16, wherein after an initial aggregation step said independent segments comprise independent multi-dimensional cubes.
18. The aggregation server of claim 16, wherein said aggregation server has a mode of operation in which data is aggregated on-the-fly after a partial pre-aggregation of data is performed.
19. The aggregation server of claim 14, wherein said aggregation server stores data aggregated on-the-fly to build up a store of aggregated data in said non-relational multi-dimensional data store to service subsequent query statements.
20. The aggregation server of claim 14, wherein said aggregation server builds up said store for a system requiring only partial pre-aggregation.
21. The aggregation server of claim 14, wherein after an initial aggregation step said independent segments comprise independent multi-dimensional cubes.
22. The aggregation server of claim 14, wherein said aggregation server has a mode of operation in which data is aggregated on-the-fly after a partial pre-aggregation of data is performed.
23. The aggregation server of claim 22, wherein said aggregation server selects a rollup order to minimize a processing delay associated with aggregating data on-the-fly to service the given query statement.
24. The aggregation server of claim 22, wherein said aggregation server selects a rollup order to reduce the amount of simultaneously handled data required to aggregate data on-the-fly to service a given query statement.
25. The aggregation server of claim 14, wherein said aggregation server stores data aggregated on-the-fly to build up a store of aggregated data in said non-relational multi-dimensional data store to service subsequent query statements.
26. The aggregation server of claim 25, wherein said aggregation server builds up said store for a system requiring only partial pre-aggregation.
27. The aggregation server of claim 14, wherein said controller is integrated within said aggregation module.
28. The aggregation server of claim 27, wherein said aggregation module comprises:
a first data communication interface for said aggregation module to interface with said relational data store and receive said base data loaded into said aggregation module from said relational data store; and
a second data communication interface for said aggregation module to interface with one or more clients having a query interface for converting queries from end-users into said query statements.
29. The aggregation server of claim 28 wherein said first and second data communication interfaces allow said aggregation module to be installed into a software-based computing environment in a cartridge-like manner.
30. The aggregation server of claim 14, wherein said aggregation module comprises:
a first data communication interface for said aggregation module to interface with said relational data store and receive said base data loaded into said aggregation module from said relational data store; and
a second data communication interface for said aggregation module to interface with one or more clients having a query interface for converting queries from end-users into said query statements.
31. An aggregation server adapted to handle large data volumes and provide rapid query response for sparse data having a tendency to experience data explosion as the number of dimensions increases, said aggregation server comprising:
an aggregation module adapted to aggregate sparse data, said aggregation module operatively coupled to a relational data store, said aggregation module including a base data loader to load base data, an aggregation engine to aggregate said base data, and a non-relational multi-dimensional data store for storing base data and aggregated data;
hierarchy logic, said hierarchy logic resolving hierarchies to reduce data handling performed on sparse data;
a controller for servicing query statements at any stage of aggregation, said controller in response to determining that data required to service a given query statement has not been pre-aggregated directs said aggregation engine to perform an aggregation on-the-fly to service the given query statement utilizing a query directed rollup in which a multi-dimensional data space is organized as independent segments to permit different rollup orders to be utilized to service the given query statement, said controller selecting a rollup order based on the given query statement and any partially pre-aggregated data present in said non-relational multi-dimensional data store to service the given query statement; and
a data directory adapted to index sparse data associated with said independent segments for rapid retrieval;
wherein each of said independent segments represents only a comparatively thin slice of the total multi-dimensional data space to reduce the amount of data that must be handled to perform an aggregation in selected dimensions with respect to an individual segment.
32. The aggregation server of claim 31, wherein said controller is integrated within said aggregation module.
33. The aggregation server of claim 32, wherein said aggregation module comprises:
a first data communication interface for said aggregation module to interface with said relational data store and receive said base data loaded into said aggregation module from said relational data store; and
a second data communication interface for said aggregation module to interface with one or more clients having a query interface for converting queries from end-users into said query statements.
34. The aggregation server of claim 33, wherein said first and second data communication interfaces allow said aggregation module to be installed into a software-based computing environment in a cartridge-like manner.
35. The aggregation server of claim 31, wherein said aggregation module comprises:
a first data communication interface for said aggregation module to interface with said relational data store and receive said base data loaded into said aggregation module from said relational data store; and
a second data communication interface for said aggregation module to interface with one or more clients having a query interface for converting queries from end-users into said query statements.
Patent Citations (202)
| Patent | Date | Inventor | Cited By |
|---|---|---|---|
| US4868733(A) | 1989-09-01 | Fujisawa et al. | Applicant |
| US4985856(A) | 1991-01-01 | Kaufman et al. | Applicant |
| US5095427(A) | 1992-03-01 | Tanaka et al. | Applicant |
| US5202985(A) | 1993-04-01 | Goyal | Applicant |
| US5257365(A) | 1993-10-01 | Powers et al. | Applicant |
| US5293615(A) | 1994-03-01 | Amada | Applicant |
| US5307484(A) | 1994-04-01 | Baker et al. | Applicant |
| US5359724(A) | 1994-10-01 | Earle | Applicant |
| US5379419(A) | 1995-01-01 | Heffernan et al. | Applicant |
| US5404506(A) | 1995-04-01 | Fujisawa et al. | Applicant |
| US5410693(A) | 1995-04-01 | Yu et al. | Applicant |
| US5519859(A) | 1996-05-01 | Grace | Applicant |
| US5553226(A) | 1996-09-01 | Kiuchi et al. | Applicant |
| US5555408(A) | 1996-09-01 | Fujisawa et al. | Applicant |
| US5696916(A) | 1997-12-01 | Yamazaki et al. | Applicant |
| US5706495(A) | 1998-01-01 | Chadha et al. | Applicant |
| US5706503(A) | 1998-01-01 | Poppen et al. | Applicant |
| US5721910(A) | 1998-02-01 | Unger et al. | Applicant |
| US5742806(A) | 1998-04-01 | Reiner et al. | Applicant |
| US5745764(A) | 1998-04-01 | Leach et al. | Applicant |
| US5765028(A) | 1998-06-01 | Gladden | Applicant |
| US5767854(A) | 1998-06-01 | Anwar | Applicant |
| US5781896(A) | 1998-07-01 | Dalal | Applicant |
| US5794228(A) | 1998-08-01 | French et al. | Applicant |
| US5794229(A) | 1998-08-01 | French et al. | Applicant |
| US5794246(A) | 1998-08-01 | Sankaran et al. | Applicant |
| US5799300(A) | 1998-08-01 | Agrawal et al. | Examiner |
| US5805885(A) | 1998-09-01 | Leach et al. | Applicant |
| US5822751(A) | 1998-10-01 | Gray et al. | Applicant |
| US5832475(A) | 1998-11-01 | Agrawal et al. | Applicant |
| US5850547(A) | 1998-12-01 | Waddington et al. | Applicant |
| US5852819(A) | 1998-12-01 | Beller | Applicant |
| US5852821(A) | 1998-12-01 | Chen et al. | Applicant |
| US5864857(A) | 1999-01-01 | Ohata et al. | Applicant |
| US5867501(A) | 1999-02-01 | Horst et al. | Applicant |
| US5884299(A) | 1999-03-01 | Ramesh et al. | Applicant |
| US5890151(A) | 1999-03-01 | Agrawal et al. | Applicant |
| US5890154(A) | 1999-03-01 | Hsiao et al. | Applicant |
| US5905985(A) | 1999-05-01 | Malloy et al. | Applicant |
| US5918225(A) | 1999-06-01 | White et al. | Applicant |
| US5918232(A) | 1999-06-01 | Pouschine et al. | Examiner |
| US5926818(A) | 1999-07-01 | Malloy | Applicant |
| US5926820(A) | 1999-07-01 | Agrawal et al. | Applicant |
| US5940818(A) | 1999-08-01 | Malloy et al. | Applicant |
| US5940822(A) | 1999-08-01 | Haderle et al. | Applicant |
| US5943668(A) | 1999-08-01 | Malloy et al. | Applicant |
| US5943677(A) | 1999-08-01 | Hicks | Applicant |
| US5946692(A) | 1999-08-01 | Faloutsos et al. | Applicant |
| US5946711(A) | 1999-08-01 | Donnelly | Applicant |
| US5963936(A) | 1999-10-01 | Cochrane et al. | Applicant |
| US5974416(A) | 1999-10-01 | Anand et al. | Applicant |
| US5978788(A) | 1999-11-01 | Castelli et al. | Applicant |
| US5978796(A) | 1999-11-01 | Malloy et al. | Applicant |
| US5987467(A) | 1999-11-01 | Ross et al. | Applicant |
| US5990892(A) | 1999-11-01 | Urbain | Applicant |
| US5991754(A) | 1999-11-01 | Raitto et al. | Applicant |
| US5999192(A) | 1999-12-01 | Selfridge et al. | Applicant |
| US6003024(A) | 1999-12-01 | Bair et al. | Applicant |
| US6003029(A) | 1999-12-01 | Agrawal et al. | Applicant |
| US6003036(A) | 1999-12-01 | Martin | Applicant |
| US6006216(A) | 1999-12-01 | Griffin et al. | Applicant |
| US6009432(A) | 1999-12-01 | Tarin | Applicant |
| US6014670(A) | 2000-01-01 | Zamanian et al. | Applicant |
| US6023695(A) | 2000-02-01 | Osborn et al. | Applicant |
| US6034697(A) | 2000-03-01 | Becker | Examiner |
| US6064999(A) | 2000-05-01 | Dalal | Applicant |
| US6073140(A) | 2000-06-01 | Morgan et al. | Applicant |
| US6078918(A) | 2000-06-01 | Allen et al. | Applicant |
| US6078924(A) | 2000-06-01 | Ainsbury et al. | Applicant |
| US6078994(A) | 2000-06-01 | Carey | Applicant |
| US6094651(A) | 2000-07-01 | Agrawal et al. | Applicant |
| US6108647(A) | 2000-08-01 | Poosala et al. | Examiner |
| US6115705(A) | 2000-09-01 | Larson | Applicant |
| US6115714(A) | 2000-09-01 | Gallagher et al. | Applicant |
| US6122628(A) | 2000-09-01 | Castelli et al. | Applicant |
| US6122636(A) | 2000-09-01 | Malloy et al. | Applicant |
| US6125624(A) | 2000-10-01 | Prociw | Applicant |
| US6134541(A) | 2000-10-01 | Castelli et al. | Applicant |
| US6141655(A) | 2000-10-01 | Johnson et al. | Applicant |
| US6151584(A) | 2000-11-01 | Papierniak et al. | Applicant |
| US6151601(A) | 2000-11-01 | Papierniak et al. | Applicant |
| US6154766(A) | 2000-11-01 | Yost et al. | Applicant |
| US6161103(A) | 2000-12-01 | Rauer et al. | Applicant |
| US6163774(A) | 2000-12-01 | Lore et al. | Applicant |
| US6167396(A) | 2000-12-01 | Lokken | Applicant |
| US6173310(B1) | 2001-01-01 | Yost et al. | Applicant |
| US6182061(B1) | 2001-01-01 | Matsuzawa et al. | Applicant |
| US6182062(B1) | 2001-01-01 | Fujisawa et al. | Applicant |
| US6189004(B1) | 2001-02-01 | Rassen et al. | Applicant |
| US6199063(B1) | 2001-03-01 | Colby et al. | Examiner |
| US6208975(B1) | 2001-03-01 | Bull et al. | Applicant |
| US6209036(B1) | 2001-03-01 | Aldred et al. | Applicant |
| US6212515(B1) | 2001-04-01 | Rogers | Applicant |
| US6212524(B1) | 2001-04-01 | Weissman et al. | Applicant |
| US6219654(B1) | 2001-04-01 | Ruffin | Applicant |
| US6223573(B1) | 2001-05-01 | Grewal et al. | Applicant |
| US6226647(B1) | 2001-05-01 | Venkatasubramanian et al. | Applicant |
| US6256676(B1) | 2001-07-01 | Taylor et al. | Applicant |
| US6260050(B1) | 2001-07-01 | Yost et al. | Applicant |
| US6269393(B1) | 2001-07-01 | Yost et al. | Examiner |
| US6275818(B1) | 2001-08-01 | Subramanian et al. | Applicant |
| US6282544(B1) | 2001-08-01 | Tse et al. | Applicant |
| US6285994(B1) | 2001-09-01 | Bui et al. | Applicant |
| US6289334(B1) | 2001-09-01 | Reiner et al. | Applicant |
| US6289352(B1) | 2001-09-01 | Proctor | Applicant |
| US6301579(B1) | 2001-10-01 | Becker | Applicant |
| US6317750(B1) | 2001-11-01 | Tortolani et al. | Applicant |
| US6321206(B1) | 2001-11-01 | Honarvar | Applicant |
| US6324623(B1) | 2001-11-01 | Carey | Applicant |
| US6332130(B1) | 2001-12-01 | Notani et al. | Applicant |
| US6339775(B1) | 2002-01-01 | Zamanian et al. | Applicant |
| US6356900(B1) | 2002-03-01 | Egilsson et al. | Applicant |
| US6363353(B1) | 2002-03-01 | Chen | Applicant |
| US6363393(B1) | 2002-03-01 | Ribitzky | Applicant |
| US6366905(B1) | 2002-04-01 | Netz | Applicant |
| US6366922(B1) | 2002-04-01 | Althoff | Examiner |
| US6374234(B1) | 2002-04-01 | Netz | Examiner |
| US6374263(B1) | 2002-04-01 | Bunger et al. | Examiner |
| US6377934(B1) | 2002-04-01 | Chen et al. | Applicant |
| US6381605(B1) | 2002-04-01 | Kothuri et al. | Applicant |
| US6401117(B1) | 2002-06-01 | Narad et al. | Applicant |
| US6405173(B1) | 2002-06-01 | Honarvar et al. | Applicant |
| US6405207(B1) | 2002-06-01 | Petculescu et al. | Applicant |
| US6411313(B1) | 2002-06-01 | Conlon et al. | Applicant |
| US6411681(B1) | 2002-06-01 | Nolting et al. | Applicant |
| US6411961(B1) | 2002-06-01 | Chen et al. | Applicant |
| US6418427(B1) | 2002-07-01 | Egilsson et al. | Applicant |
| US6418450(B2) | 2002-07-01 | Daudenarde | Applicant |
| US6421730(B1) | 2002-07-01 | Narad et al. | Applicant |
| US6424979(B1) | 2002-07-01 | Livingston et al. | Applicant |
| US6430545(B1) | 2002-08-01 | Honarvar et al. | Applicant |
| US6430547(B1) | 2002-08-01 | Busche et al. | Applicant |
| US6434557(B1) | 2002-08-01 | Egilsson et al. | Applicant |
| US6438537(B1) | 2002-08-01 | Netz et al. | Applicant |
| US6442269(B1) | 2002-08-01 | Ehrlich et al. | Applicant |
| US6442560(B1) | 2002-08-01 | Berger et al. | Applicant |
| US6446059(B1) | 2002-09-01 | Berger et al. | Applicant |
| US6446061(B1) | 2002-09-01 | Doerre et al. | Applicant |
| US6453322(B1) | 2002-09-01 | DeKimpe et al. | Applicant |
| US6456999(B1) | 2002-09-01 | Netz | Applicant |
| US6460031(B1) | 2002-10-01 | Wilson et al. | Applicant |
| US6470344(B1) | 2002-10-01 | Kothuri et al. | Applicant |
| US6473750(B1) | 2002-10-01 | Petculescu et al. | Applicant |
| US6480842(B1) | 2002-11-01 | Agassi et al. | Examiner |
| US6480848(B1) | 2002-11-01 | DeKimpe et al. | Applicant |
| US6480850(B1) | 2002-11-01 | Veldhuisen | Applicant |
| US6484179(B1) | 2002-11-01 | Roccaforte | Applicant |
| US6487547(B1) | 2002-11-01 | Ellison et al. | Applicant |
| US6460026(B1) | 2002-12-01 | Pasumansky et al. | Applicant |
| US6493718(B1) | 2002-12-01 | Petculescu et al. | Applicant |
| US6493723(B1) | 2002-12-01 | Busche | Applicant |
| US6510457(B1) | 2003-01-01 | Ayukawa et al. | Applicant |
| US6513019(B2) | 2003-01-01 | Lewis | Applicant |
| US6532458(B1) | 2003-03-01 | Chaudhuri et al. | Applicant |
| US6535866(B1) | 2003-03-01 | Iwadate | Applicant |
| US6535868(B1) | 2003-03-01 | Galeazzi et al. | Applicant |
| US6542886(B1) | 2003-04-01 | Chaudhuri et al. | Applicant |
| US6542895(B1) | 2003-04-01 | DeKimpe et al. | Applicant |
| US6546395(B1) | 2003-04-01 | DeKimpe et al. | Applicant |
| US6546545(B1) | 2003-04-01 | Honarvar et al. | Applicant |
| US6549907(B1) | 2003-04-01 | Fayyad et al. | Examiner |
| US6557008(B1) | 2003-04-01 | Temple et al. | Applicant |
| US6560594(B2) | 2003-05-01 | Cochrane et al. | Applicant |
| US6567796(B1) | 2003-05-01 | Yost et al. | Applicant |
| US6567814(B1) | 2003-05-01 | Bankier et al. | Applicant |
| US6581054(B1) | 2003-06-01 | Bogrett | Applicant |
| US6581068(B1) | 2003-06-01 | Bensoussan et al. | Applicant |
| US6587547(B1) | 2003-07-01 | Zirngibl et al. | Examiner |
| US6587857(B1) | 2003-07-01 | Carothers et al. | Applicant |
| US6601034(B1) | 2003-07-01 | Honarvar et al. | Applicant |
| US6604135(B1) | 2003-08-01 | Rogers et al. | Applicant |
| US6606638(B1) | 2003-08-01 | Tarin | Applicant |
| US6609120(B1) | 2003-08-01 | Honarvar et al. | Applicant |
| US6615096(B1) | 2003-09-01 | Durrant et al. | Applicant |
| US6628312(B1) | 2003-09-01 | Rao et al. | Applicant |
| US6633875(B2) | 2003-10-01 | Brady | Applicant |
| US6643608(B1) | 2003-11-01 | Hershey et al. | Applicant |
| US6671715(B1) | 2003-12-01 | Langseth et al. | Applicant |
| US6677963(B1) | 2004-01-01 | Mani et al. | Applicant |
| US6678674(B1) | 2004-01-01 | Saeki | Applicant |
| US6691118(B1) | 2004-02-01 | Gongwer et al. | Applicant |
| US6691140(B1) | 2004-02-01 | Bogrett | Applicant |
| US6694316(B1) | 2004-02-01 | Langseth et al. | Applicant |
| US6707454(B1) | 2004-03-01 | Barg et al. | Applicant |
| US6708155(B1) | 2004-03-01 | Honarvar et al. | Applicant |
| US6738975(B1) | 2004-05-01 | Yee et al. | Applicant |
| US6816854(B2) | 2004-11-01 | Reiner et al. | Applicant |
| US6826593(B1) | 2004-11-01 | Acharya et al. | Applicant |
| US6836894(B1) | 2004-12-01 | Hellerstein et al. | Applicant |
| US6842758(B1) | 2005-01-01 | Bogrett | Applicant |
| US6867788(B1) | 2005-05-01 | Petculescu et al. | Applicant |
| US6898603(B1) | 2005-05-01 | Petculescu et al. | Applicant |
| US6934687(B1) | 2005-08-01 | Papierniak et al. | Applicant |
| US6947934(B1) | 2005-09-01 | Chen et al. | Applicant |
| EP314279(A2) | 1989-05-01 | Applicant | |
| EP743609(A2) | 1996-11-01 | Applicant | |
| EP336584(A3) | 1997-02-01 | Applicant | |
| EP869444(A2) | 1998-10-01 | Applicant | |
| WO95/08794(A1) | 1995-03-01 | Applicant | |
| WO98/40829(A1) | 1998-09-01 | Applicant | |
| WO98/49636 | 1998-11-01 | Applicant | |
| WO99/09492(A1) | 1999-02-01 | Applicant |
Non-Patent Literature (304)
- Scientific article entitled “Efficiently Supporting Ad Hoc Queries in Large Datasets of Time Sequences” by Flip Korn et al.; Presented at ACM SIGMOD International Conference on Management of Data, May 11-15, 1997, http://www.acm.org/pubs/citations/proceedings/mod/253260.p289-korn/, pp. 1-22.Applicant
- Scientific article entitled “Towards the Building of a Dense-Region-Based OLAP System” by Cheung et al., Data and Knowledge Engineering, vol. 36, No. 1, 2001, http://www.elsevier.nl/gej-ng/10/16/74/62/24/24/abstract.html, pp. 1-27.Applicant
- Web-based product brochure entitled “See Data from All Angles with Multidimensional Database Software” by SAS/MCCB® Server, www.sas.com/products/mddb/index.html, 2001, 1 page.Applicant
- Scientific article entitled “How to Roll a Join: Asynchronous Incremental View Maintenance” by Salem et al.; Presented at ACM SIGMOD on Management of Data and Symposium on Principles of Database Systems, May 15-18, 2000, http://www.acm.org/pubs/citations/proceedings/mod/342009/p129-salem/#abstract, pp. 1-13.Applicant
- Scientific article entitled “Hierarachies and Relative Operators in the OLAP Environment” by Pourabbas et al., SIGMOD Record, vol. 29, No. 1, Mar. 2000, http://dblp.uni-trier.de/db/journals/sigmod/sigmod29.html, pp. 1-8.Applicant
- Chapter 4 entitled “Extending Practical Pre-Aggregation in On-Line Analytical Processing” of the Ph.D Dissertation entitled “Aspects of Data Modeling and Query Processing for Complex Multidimensional Data” by Torben Bach Pedersen, Danish Academy of Technical Sciences 2000, pp. 1-103.Applicant
- Scientific article entitled “Characterization of Hierarchies and Some Operators in OLAP Environment” by Pourabbas, et al.; Presented at the ACM 2nd International Workshop on Data Warehousing and OLAP, Nov. 2-6, 1999, pp. 1-17.Applicant
- Scientific article entitled “Aggregate-based Query Processing in a Parallel Data Warehouse Server” by Jens Albrecht and Wolfgang Sporer; Presented at the 10th International Workshop on Database and Expert Systems, Sep. 1-3, 1999, pp. 40-44.Applicant
- Scientific article entitled “Open OLAP” by Stephen B. Elkins, DBMS Apr. 1998, http://www.dbmsmag.com/9804d14.html, pp. 1-7.Applicant
- Scientific article entitled “Efficient Execution of Operations in a DBMS for Multidimensional Arrays” by Widman et al., presented at the ACM SIGMOD 1998, http://dblp.uni-trier.de/db/conf/ssdbm/WidmannB98.html, pp. 1-11.Applicant
- Scientific article entitled “Online Aggregation” by Hellerstein et al.; Presented at the ACM SIGMOD International Conference on Management of Data, May 11-15, 1997, http://www.acm.org/pubs/citations/proceedings/mod/253260/p171-hellerstein/, pp. 1-12.Applicant
- Scientific article entitled “Range Queries in OLAP Data Cubes” by Ching-Tien Ho et al.; Presented at the ACM SIGMOD International Conference on Management of Data, May 11-15, 1997, http://www.acm.org/pubs/citations/proceedings/mod/253260/p73-ho/, pp. 1-16.Applicant
- Research Report entitled “Modeling Multidimensional Databases” by R. Agrawal et al., IBM Almaden Research Center, 1995; Presented at the 13th International Conference on Data Engineering Apr. 1997, pp. 1-23.Applicant
- Scientific article entitled “A Data Model for Supporting On-Line Analytical Processing” by C. Li and X.S. Wang; Presented at the International Conference on Information and Knowledge Management, 1996, pp. 81-88.Applicant
- Scientific article entitled “On the Computation of Multidimensional Aggregates” by S. Agarwal et al.; Presented at the 22nd VLDB Conference, 1996, pp. 1-16.Applicant
- Web-based Product Review for Arbor Software Corporation's “Essbase 4.0” by Stewart McKie, DBMS, Jul. 1996, http://www.dbmsmag.com/9607d13.html, pp. 1-4.Applicant
- Scientific article entitled “Implementing Data Cubes Efficiently” by Venky Harinarayan et al.; Presented at the ACM SIGMOD International Conference on Management of Data, Jun. 4-6, 1996, pp. 205-216.Applicant
- Scientific article entitled “Optimizing Statistical Queries by Exploiting Orthogonality and Interval Properties of Grouping Relations” by C. Li and X. Wang; Presented at the 8th International Conference on Scientific & Statistical Database Management, Jun. 1996, pp. 1-10.Applicant
- “Checking Out OLAP Architectures: Technology Information” by Robert Craig; a Boucher Communications, Inc. publication, Section No. 12, vol. 2; 1997; p. 40, ISSN: 1085-2395.Applicant
- “OLAP, Relational, and Multidimensional Database Systems”; George Colliat; SIGMOD Record, vol. 25, No. 3, Sep. 1996, pp. 64-69.Applicant
- “The Aggregate Navigator; How to Optimize Your Data Warehouse Using Aggregates Without Driving Your End Users Crazy”, by Ralph Kimball; DBMS (www.dbmsmag.com)—Nov. 1995.Applicant
- “The Origins of Today's OLAP products” by Nigel Pendse, http://www.olapreport.com/origins.htm., Feb. 6, 2003, pp. 1-7.Applicant
- comp.databases' website re Access DBMS? Not RDBMS? Jun. 1994.Applicant
- Rana, et al., A Distributed Framework for Parallel Data Mining Using HP Java, BT technol J vol. 17 No. 3 Jul. 1999.Applicant
- Internet Systems' website re A New Face for OLAP by Rich Carickhoff Jan. 1997.Applicant
- Windows IT Pro's website re A New Kid on the OLAP Block by Karen Watterson May 1, 1998.Applicant
- Attunity Connect SQL - PowerPoint presentation undated 38 pages.Applicant
- Schumacher, Robin. BrioQuery Enterprise 4.0; Brio Technology's desktop OLAP tool, Lexis.com DBMS Magazine vol. 9 No. 10 Sep. 1996.Applicant
- NetCube Corporation manual. Number of Installed Sites. Characteristics of Typical System Implementations.Applicant
- Michael, J. and S. Muza DM Review's website re Charles Schwab Plans for Continued Prosperity with Seagate Holos.Applicant
- Craig, Robert. Checking out OLAP Architectures; Technology Information.Lexis ENT vol. 2 No. 12 Aug. 20, 1997.Applicant
- Spitzer, Tom. Component architectures; component-based software development; technology information, Lexis DBMS Magazine vol. 10 No. 10 Sep. 1997.Applicant
- Winter, R. Intelligent Enterprise's website re Databases: Back in the OLAP Game vol. 1 No. 4 Dec. 15, 1998.Applicant
- scholar.google website re Data Warehouse for Decision Supoort Systems.Applicant
- Bearson et al., “Data Warehousing, Data Mining, and OLAP.” pp. 104-107.Applicant
- Kurz, Andreas, A Min Tjoa, Data Warehousing within Intranet: Prototype of a Web-based Executive Information System, Abstract 1997.Applicant
- Elkins, S.B. Islands of OLAP DBMS Magazine Apr. 1998.Applicant
- McKie, S. dbmsmag's website re What's New in 4.O DBMS Magazine Jul. 1996.Applicant
- Reimers, How to Sort Through the OLAP Maze, Lexis Software Magazine vol. 17 No. 5 May 1997.Applicant
- HyperRoll's website re HyperRoll for Hyperion Essbase.Applicant
- Bontempo et al., The IBM Data Warehouse Architecture, Communications of the ACM (vol. 41 No. 9) Sep. 1998.Applicant
- Davis, Judith. IBM's DB2 Spatial Extender: Managing Geo-Spatial Information Within the DBMS, IBM corporation May 1998.Applicant
- Information Builders Intros “Fushion” MDDS Warehouse, Post-Newsweek Business Information Inc. Lexis May 16, 1996.Applicant
- Manual. 2 Introducing ClearConnect and DRDA ClearConnect Installlation and Reference Guide.Applicant
- A White Paper - Maximizing Database Performance with The OMNIDEX Query Accelerator.Applicant
- Chen et al., OLAP-Based Scalable Profiling of Customer Behavior, Abstract 1999.Applicant
- Pendse, N. The OLAP Report's website OLAP Architectures 2005.Applicant
- Greenberg, Ilan. OLAP or ROLAP, InfoWorld Jun. 10, 1996.Applicant
- Pendse, N. The OLAP Report's website re Database Explosion 1998.Applicant
- Comp.databases' website re OLAP Storage Algorithms 1997.Applicant
- Biggs, Maggie. Pilot Lands Impressive OLAP Suite, Product Reviews Info World vol. 20 No. 36 Sep. 7, 1998.Applicant
- Maierhofer, Enrich. Present Limitations of Web-Enabled HOLAP: Empirical Experiments with Employment and Unemployment Statistics, Abstract.Applicant
- Codd et al., Providing OLAP to User-Analysts: An IT Mandate. Hyperion Solutions Corporation.Applicant
- Harrington, Jan. Relational Database Design Clearly Explained. Morgan Kaufmann pp. 1-62.Applicant
- blgate.cl's website re Seagate Holos Roadmap.Applicant
- Yoshizawa et al., SQL Based Association Rule Mining Using Commercial RDBMS (IBM DB2 UDB EEE) Abstract 2000.Applicant
- Spinner, Karen. Unlocking the Data Warehouse with OLAP, Wall Street & Technology vol. 15 No. 1 Jan. 1, 1997 p. PD18.Applicant
- Taylor, The Warehouse Meets the Web, The Data Administration Newsletter (Mar. 21, 2005).Applicant
- Nadeau et al., Achieving Scalaboloty in OLAP Materialized View Selection (Extended Version), (2002) Proceedings of DOLAP '02 Nov. 8, 2002.Applicant
- Whitney, R. Windows IT, Pro Website Page re: SQL Server Analysis 8.0 May 2000.Applicant
- Fernandez, Red Brick Warehouse: A Read-Mostly RDBMS for Open SMP Platforms.Applicant
- Raden, Boost Warehouse Performance Technology Tutorial Part II (2002).Applicant
- Rowe et al., Data Abstraction, Views and Updates in Rigel (1979).Applicant
- Graefe, DataCube: An Integrated Data and Compute Server Based on A Hypercube-Connected Dataflow Database Machine, Oregon Graduate Center (Jul. 1988).Applicant
- Berson and Smith, Data Warehousing, Data Mining, and OLAP, McGraw-Hill Companies 1997 pp. 247-266.Applicant
- Shahzad, Data Warehousing with Oracle, Oracular, Inc.Applicant
- Berson and Smith, Data Warehousing, Data Mining, and OLAP, McGraw-Hill Companies 1997 pp. 98-100.Applicant
- Watterson, K. Windows IT Pro Website Page re: DB2 OLAP Server 1.0 Sep. 1998.Applicant
- Kalman, D and T. Riginey DBMS Online's website re Sybase Inc.'s Dennis McEvoy--System 11 Strategy Oct. 1995.Applicant
- Mohan, DWMS: Data Warehousing Management System, Software AG of Far East, Inc. Proceedings of the 22nd VLDB Conference 1996 p. 588-.Applicant
- aaaprod's website re Hybrid Database.Applicant
- sbt's website re Data Management - A Bedtime Story for Database Managers.Applicant
- Data Sheet - Designed and Optimized for Business-Critical Data Warehousing, Informix Red Brick Warehouse.Applicant
- Microsoft website re Introduction to OLE DB for OLAP 2005.Applicant
- iwaysoftware's website re Accelerating Red Brick Integration.Applicant
- Microsoft SQL Server 7.0 - SQL Server Design Goals.Applicant
- Lau., Microsoft SQL Server 7.0 Performance Tuning Guide, SQL7 performance tuning.doc Oct. 1998.Applicant
- Lyco's website re prices on Microsoft SQL Server 7.0 for PC.Applicant
- Gimarc and Spellman., Modeling Microsoft SQL Server 7.0. Abstract - SES Proceedings of CMG '98 Dec. 6-11, 1998.Applicant
- Andrews, D. byte's website re Jeff Stamen, senior vice president of Oracle's OLAP division, discusses the convergence of multidimensional and relational OLAP databases Aug. 1996.Applicant
- Margaritis et al., Netcube: A Scalable Tool for Fast Data Mining and Compression, Abstract - Camegie Mellon University Proceedings of the 27th VLDB Conference 2001.Applicant
- Pfeiff, B. Windowsitpro's website re OLAP: Resistance is Futile! Apr. 1999.Applicant
- database.olap's website re OLAP with Regression Analysis, Built for Analysts? Jun. 1990.Applicant
- Elkins., Open OLAP, DBMS Apr. 1998.Applicant
- Endress., Oracle 9i OLAP Release 2: A Relational-Multidimensional Database for Business Intelligence, Oracle.Applicant
- Oracle Express Relational Access Manager, A Source-Transparent Decision Support Solution.Applicant
- Oracle Express Server, Enhanced Corporate Performance.Applicant
- White Paper - Delivering OLAP to the Enterprise, Oracle Jan. 1997.Applicant
- databases.olap's website re Oracle for reporting?Nov. 2002.Applicant
- PartitionAggregationss7.txt.Applicant
- Lexis - Red Brick, Accrue to embed Red Brick Warehouse RDBMS in online user response analysis system, M2 Presswire.Applicant
- Colby et al., Red Brick Vista: Aggregate Computation and Management, Abstract - Red Brick Systems, Inc.Applicant
- Red Brick Vista: Aggregate Computation and Management, Red Brick Systems, Inc.Applicant
- Rennhackkamp, M, DBMS online's website re Red Brick Warehouse 5.1, Relational data warehousing and data mining are reaching new heights Jun. 1998.Applicant
- White Paper - Extending the Scale, Reach, and Range of Your Data Warehouse, Next-Generation Data Warehousing, Sybase Interactive Warehouse.Applicant
- Rennhackkamp, M. DBMSmag's website re A Black Eye Heals as Sybase System 11 Recovers from Performance and Quality Problems in System 10 Nov. 1996.Applicant
- Rennhackkamp, M. DBMS online's website re An Interactive Warehousing Architecture Can Extend the Scale of Your Information Aug. 1997.Applicant
- Moorman., The Art of Designing HOLAP Database, SAS Institute Inc. [Paper 139].Applicant
- McKie, S. - The Informix Enterprise Strategy, Information Access Company, DBMS Magazine vol. 9 No. 7 p. 42 Jun. 1996.Applicant
- Campbell, The New Locking, Logging, and Recover Architecture of Microsoft SQL Server 7.0, Microsoft Corporation Proceedings of the 25th VLDB Conference 1999 p. 249.Applicant
- Weinberger and Ender., The Power of Hybrid OLAP in a Mulidimensional World, SAS Institute Inc. [Paper 133-25].Applicant
- Rigney, T. DBMS online's website re The Sybase Enterprise May 1996.Applicant
- Raden, Worlds in Collision, Merging Business and IT Architecture Perspectives to Evaluate Query and Analysis Tools Successfully, DBMS Magazine Aug. 1997.Applicant
- Nadeau & Teorey, Achieving Scalability in OLAP Materialized View Selection, DOLAP 02.Applicant
- Buzydlowski et al., A Framework for Object-Oriented On-Line Analytic Processing, Abstract - DOLAP Proceedings of DOLAP '98 1998.Applicant
- Liu and Ursu, A Framework for Global Optimization of Aggregate Queries, Abstract - CIKM Proceedings of CIKM '97, 1997.Applicant
- Shoshani and Rafanelli., A Model for Representing Statistical Objects, Abstract - Lawrence Berkeley Lab.Applicant
- Mangisengi., A Multidimensional Modeling Approach for OLAP within the Framework of the Relational Model Based on Quotient Relations, Abstract - DOLAP Proceedings of DOLAP '98 1998.Applicant
- Trujillo et al., An Object Oriented Approach to Multidimensional Database Conceptual Modeling (OOMD), Abstract - DOLAP Proceedings of DOLAP '98 1999.Applicant
- Bose and Sugumaran., Application of Intelligent Agent Technology for Managerial Data Analysis and Mining, Abstract -Data Base The Data Base for Advances in Information Systems vol. 30 No. 1 winter 1999.Applicant
- Damiani and Bottarelli, A Terminological Approach to Business Domain Modeling, Abstract - EEC Proceedings of the International Conference on Database and Expert Systems 1990.Applicant
- DeWitt et al., Client-Server Paradise, Abstract Proceedings of the 20th VLDB Conference 1994.Applicant
- McFadden., Data Warehouse for EIS: Some Issues and Impacts, Abstract - IEEE 1996 Proceedings of the 29th Hawaii Conference on Systems Sciences.Applicant
- Cheung et al., DROLAP - A Dense-Region Based Approach to On-Line Analytical Processing, Abstract-DEXA '99.Applicant
- Kotdis and Roussopoulos., DynaMat: A Dynamic View Management System for Data Warehouses Abstract.Applicant
- Sun and Grosky., Dynamic Maintenance of Multidimensional Range Data Partitioning for Parallel Data Processing, Abstract - DOLAP '98.Applicant
- Peneva and Angelova., End-User Interface to Improve Microcomputer DBMS Efficiency, Abstract Proceedings of the International Conference on Database and Expert System Applications 1991.Applicant
- Rudensteiner and Bic., Evaluating Aggregates in Possibilistic Relational Databases, Abstract Jan. 1991.Applicant
- Hsiao et al., The Federated Databases and System: A New Generation Advanced Database System, Abstract Proceeding of DEXA '90.Applicant
- Eder., General Transitive Closures and Aggregate Functions, Abstract Proceedings of DEXA '91.Applicant
- Goil and Choudhary, High Performance Data Mining Using Data Cubes on Parallel Computers, Abstract - IEEE 1998.Applicant
- Goil and Choudhary, High Performance Multidimensional Analysis of Large Datasets, Abstract - DOLAP '98.Applicant
- Muto and Kitsuregawa, Improving Main Utilization for Array-Based Datacube Computation, Abstract - DOLAP '98.Applicant
- Nestorov and Tsur, Integrating Data Mining with Relational DBMS: A Tightly-Coupled Approach, Abstract - NGITS '99.Applicant
- Fernandez-Baizan et al., Integrating KDD Algorithms and RDBMS Code, Abstract Proceedings of RSCTC '98.Applicant
- Andlinger et al., Making C++ Object Persistent by Using a Standard Relational Database System Proceedings of DEXA '91.Applicant
- Rafanelli and Ricci, Mefisto: A Functional Model for Statistical Entities, IEEE 1993.Applicant
- Lehner, Modeling Large Scale OLAP Scenarios.Applicant
- Gunzel et al., Modeling of Census Data in a Multidimensional Environmental, Springer Proceedings of ADBIS '98 Sep. 7-10, 1998.Applicant
- SAP Multi-Dimensional Modeling with BW, ASAP for BW Accelerator - A background to the techniques used to create SAP BW InfoCubes Document Version 2.0 2000.Applicant
- Gingras and Lakshmanan, nD-SQL: A Multi-Dimensional Language for Interoperability and OLAP, Abstract Proceedings of the 24th VLDB Conference 1998.Applicant
- Shoshani, OLAP and Statistical Databases: Similarities and Differences, Abstract - PODS Proceedings of PODS '97 1997.Applicant
- Shatdal, Order Based Analysis Functions in NCR Teradata Parallel RDBMS, Abstract Proceeding of EDBT 2000.Applicant
- PartitionAggregations7.txt.Applicant
- Albrecht et al., An Architecture for Distributed OLAP, Abstract Proceedings of PDPTA '98.Applicant
- Charczuk, Physical Structure Design for Relational Databases, Abstract Proceedings of ADBIS '98.Applicant
- Chaudhuri et al., Scalable Classification over SQL Databases, Abstract.Applicant
- Zhao et al., Simultaneous Optimization and Evaluation of Multiple Dimensional Queries, Abstract.Applicant
- Lenz and Shoshani, Summarizability in OLAP and Statistical Data Bases, Abstract - IEEE 1997.Applicant
- Hwang, Summary Data Representations in Application Developments, Abstract Proceedings of DEXA '93 Sep. 1993.Applicant
- Dinter et al., The OLAP Market: State of the Art and Research Issues, Abstract - DOLAP '98.Applicant
- Han, Towards On-Line Analytical Mining in Large Databases, Abstract.Applicant
- Wieczerzycki, Transaction Management in Databases Supporting Collaborative Applications, Abstract Proceedings of ADBIS '98 1998.Applicant
- Bellahsene, View Adaption in Data Warehousing Systems, Abstract Proceedings of DEXA '98 Aug. 1998.Applicant
- Datta et al., A Case for Parallelism in Data Warehousing and OLAP.Applicant
- Batini et al, A Comparative Analysis of Methodologies for Data Schema Integration,ACM Computing Surveys, vol. 18, No. 2 Dec. 1986.Applicant
- Datta and Thomas., A Conceptual Model and Algebra for On-Line Analytical Processing in Data Warehouses.Applicant
- Shatdal and Naughton., Adaptive Parallel Aggregation Algorithms.Applicant
- Gyssens and Lakshmanan., A Foundation for Multi-Dimensional Databases Proceedings of the 23rd VLDB Conference 1997.Applicant
- Gupta et al., Aggregate-Query Processing in Data Warehousing Environments Proceedings of the 21st VLDB Conference 1995.Applicant
- Devlin and Murphy., An Architecture for a Business and Information System,IBM Systems Journal, vol. 27, No. 1 1998.Applicant
- Nadeau and Teorey., A Pareto Model for OLAP View Size Estimation.Applicant
- Codd., A Relational Model of Data for Large Shared Data Banks,Communications of the ACM, vol. 13, No. 6 Jun. 1970.Applicant
- Vassiliadis and Sellis., A Survey of Logical Models for OLAP Database, SIGMOD Record, vol. 28, No. 4 Dec. 1999.Applicant
- Attunity's website page re Home page with Headlines.Applicant
- Chaudhuri and Narasayya., AutoAdmin “What-if” Index Analysis Utility Proceedings of SIGMOD '98.Applicant
- Lu and Tan., Buffer and Load Balancing in Locally Distributed Database Systems 1990.Applicant
- Shanmugasundaram., Compressed Data Cubes for OLAP Aggregate Query Approximation on Continuous Dimensions Proceedings of the KDD '99 Conference.Applicant
- Barghoorn., N-dimensional Data Analysis with Sparse Cubes, Crosstab, OLAP, and APL Proceedings of the APL '98 Conference.Applicant
- Hired Brains' website page re Article called Data, Data Everywhere written by Neil Raden.Applicant
- Agrawal et al., Database Mining: A Performance Perspective.Applicant
- Gray et al., Data Cube: A Relational Aggregation Operator Generalizing Group-By, Cross-Tab, and Sub-Totals 1996.Applicant
- Chaudhuri and Dayal., Data Warehousing and OLAP for Decision Support Proceedings of SIGMOD '97.Applicant
- Stanford Technology Group, In. An Informix Company's website page re Designing the Data Warehouse on Relational Databases.Applicant
- Trujillo et al., Detecting Patters and OLAP Operations in the GOLD Model, DOLAP '99.Applicant
- Garcia-Molina et al., Invited Talk: Distributed and Parallel Computing Issues in Data Warehousing.Applicant
- Yan and Larson., Eager Aggregation and Lazy Aggregation, Proceedings of the 21st VLDB Conference Zurich, Swizerland 1995.Applicant
- Johnson and Chatziantoniou., Extending Complex Ad-Hoc OLAP Proceedings of CIKM '99.Applicant
- Pedersen et al., Extending OLAP Querying To Object Databases, VLDB 2000 Submission.Applicant
- Pedersen et al., Extending Practical Pre-Aggregation in On-Line Analytical Processing Proceedings of the 25th VLDB Conference 1999.Applicant
- Codd, Extending the Database Relational Model to Capture More Meaning, ACM Transactions on Database Systems, vol. 4, No. 4 Dec. 1979.Applicant
- Sheth and Larson, Federated Database Systems for Managing Distributed, Heterogeneous, and Autonomous Databases, ACM Computing Surveys, vol. 22, No. 3 Sep. 1990.Applicant
- Szykier, Fractal Compression of Data Structures, Electro International 1994 Hynes Convention Center May 10-12, 1994.Applicant
- Graefe et al., Hash joins and hash teams in Microsoft SQL Server Proceedings of the 24th VLDB Conference 1998 pp. 86-97.Applicant
- Johnson and Shasha, Hierarchically Split Cube Forests for Decision Support: description and tuned design.Applicant
- Chandra and Harel, Horn Clauses and the Fixpoint Query Hierarchy 1982.Applicant
- A White Paper by Speedware Corporation, Hybrid OLAP - The Best of Both Worlds 1997.Applicant
- Google's website page re Central Canada DB2 Users Group News Announced: IBM DB2 Universal Database Version 5.2.Applicant
- Markl et al., Improving OLAP Performance by Multidimensional Hierarchical Clustering Proceedings of IDEAS '99 1999.Applicant
- Chaudhuri and Shim, Including Group-By in Query Optimization Proceedings of the 20th VLDB Conference 1994.Applicant
- Salzberg and Reuter, Indexing for Aggregation.Applicant
- Murnick et al., Maintenance of Data Cubes and Summary Tables in a Warehouse Proceedings of SIGMOD '97 1997.Applicant
- Vigeant, J. DM Review's website page re Media / MR Ensures Consistency for IBM Consultancy Jan. 1998.Applicant
- Media / MR The Hybrid OLAP Technology for the Enterprise, Speedware Corporation, Inc.Applicant
- McCarthy, Metadata Management for Large Statistical Databases Proceedings of the 8th VLDB Conference 1982. PP. 234-243.Applicant
- Ferguson, Microeconomic Algorithms for Load Balancing in Distributed Computer Systems, 1988.Applicant
- Foley, J. TechWeb's website page re Microsoft Servers Up New SQL Server Beta Jan. 12, 1998.Applicant
- Quass and Widom, On-Line Warehouse View Maintenance for Batch Updates.Applicant
- Sarawagi, Research Report on Computing the Data Cube,IBM Research Division.Applicant
- Chen and McNamee, On the Data Model and Access Method of Summary Data Management, IEEE Transactions On Knowledge and Data Engineering, vol. 1, No. 4 1989.Applicant
- Sellis and Ghosh, Concise Papers On the Multiple-Query Optimization Problem, IEEE Transactions on Knowledge and Data Engineering, vol. 2, No. 2 1990.Applicant
- DBMS's website page re Oracle 7 Release 7.3 by Martin Rennhackkamp.Applicant
- DeWitt and Gray, Parallel Database Systems: The Future of High Performance Database Systems, Communications of the ACM, vol. 35, No. 6 Jun. 1992.Applicant
- Ho et al., Partial-Sum Queries in OLAP Data Cubes Using Covering Codes Proceedings of PODS '97 1997.Applicant
- Ramsak et al., Physical Data Modeling for Multidimensional Access Methods.Applicant
- Pourabbas and Rafanelli, PQL: An Extended Pictorial Query Language for querying Geographical Databases using Positional and OLAP Operators Proceedings of ACM GIS '99 Nov. 1999.Applicant
- Markl et al., Processing Operations with Restrictions in RDBMS without External Sorting: The Tetris Algorithm Proceedings of ICDE '99 1999.Applicant
- Cabibbo and Torlone, Querying Multidemsional Databases.Applicant
- Bansal, Real World Requirements for Decision Support-Implications for RDBMS Proceedings of SIGMOD '95 1995 p. 448.Applicant
- Tabor Communications' website page re SAP Customers Eastman Kodak and Halliburton Among 750 Customers Worldwide to Implement the SAP Business Information Warehouse Solution 1999.Applicant
- Gupta, Selection of Views to Materialize in a Data Warehouse.Applicant
- Graefe et al., Sort vs. Hash Revisited, IEEE Transactions on Knowledge and Data Engineering, vol. 6, No. 6. Dec. 1994.Applicant
- Speedware's website page re Media - Features & Benefits.Applicant
- Red Brick Systems, Inc. Star Schema Processing for Complex Queries 1997.Applicant
- Shoshani and Wong., Statistical and Scientific Database Issues, IEEE Transactions on Software Engineering, vol. SE-11, No. 10. Oct. 1985.Applicant
- Ghosh, Statistical Relational Database: Normal Forms, IEEE Transactions on Knowledge and Data Engineering, vol. 3, No. 1. 1991.Applicant
- Shoshani and Rafanelli., A Model for Representing Statistical Objects.Applicant
- Stamen, Structuring Database for Analysis, IEEE Spectrum.Applicant
- The OLAP Report website page re Summary Review: Media (Speedware).Applicant
- Sybase Inc.'s website page re Certification Report No. 136 of Sybase Adaptive Server IQ Version 12.02 with Seagate Software Crystal Reports and Crystal Info Version 7.0v Jun. 1999.Applicant
- Bliujute et al., Systematic Change Management in Dimensional Data Warehousing.Applicant
- Gyssens et al., Tables As a Paradigm for Querying and Restructuring Proceedings of PODS '96 1996.Applicant
- Srivastava et al., TBSAM: An Access Method for Efficient Processing of Statistical Queries, IEEE Transactions of Knowledge and Data Engineering, vol. 1. No. 4 1989.Applicant
- LeFevre, J. There's a Whole Lot of HOLAP Goin' On-hybrid online analytical processing systems combine relational OLAP and multidimensional OLAP - Technology Information Feb. 18, 1998.Applicant
- Marklet., The Transbase Hypercue RDBMS: Multidimensional Indexing of Relational Tables.Applicant
- Bayer, UB-Trees and UB-Cache A new Processing Paradigm for Database Systems Mar. 15, 1997.Applicant
- Aho and Ullman, Universality of Data Retrieval Languages.Applicant
- Hurtado et al., Updating OLAP Dimensions Proceedings of DOLAP '99 1999 pp. 60-66.Applicant
- Advanced Communication Technologies website page re CT's Vision & Strategy.Applicant
- White Paper Abstract - Connecting Seagate Software products to the SAP Business Information Warehouse (BW), Enterprise Information Management Feb. 5, 1999.Applicant
- Crystal Reports: A Beginner's Guide. Module 1 Getting Started.Applicant
- Roussopoulos et al., The Cubetree Storage Organization, Advanced Comunication Technology, Inc.Applicant
- Healthcare Informatics.Online website page re Data Mining Goes Multidimensional by Mark Hettler Mar. 1997.Applicant
- Roussoopoulos et al., A High Performance ROLAP Datablade [power point presentation].Applicant
- Staudt et al., Incremental Maintenance of Externally Materialized Views, Abstract Proceedings of the 22nd VLDB Conference 1996 pp. 75-86.Applicant
- Organizations Survival website page re New Version of Hyperion Essbase OLAP Server Raises Bar for Deploying Analytic Application Across . . . downloaded from www.organizationalsurvival.com.Applicant
- White Paper - Pilot Analysis Server, Multi-dimensional OLAP Engine Including Hybrid OLAP.Applicant
- Pilot Internet Publisher: A Foundation for Web-Enabled OLAP.Applicant
- Seagate Holos 7 - Series 1, Supported Platforms, Operating Systems and Databases.Applicant
- Srivastava et al., Answering Queries with Aggregation Using Views, Abstract. Proceedings of the 22nd VLDB Conference 1996.Applicant
- Zou et al., Back to the Future: Dynamic Hierarchical Clustering, Abstract.Applicant
- Patel et al., Building a Scalable Geo-Spatial DBMS: Technology, Implementation, and Evaluation, Abstract.Applicant
- Data Flux Registration's website re Customer Data Integration: Creating One True View of the Customer.Applicant
- Martin, J. DM Review's website re Cybercorp: Trends in Distributed Data Warehousing.Applicant
- Rolleigh et al., Data Integration: The Warehouse Foundation.Applicant
- Theodoratos et al., Data Warehouse Configuration, Abstract Proceedings of the 23rd VLDB Conference 1997.Applicant
- Malvestuto, F., The Derivation Problem for Summary Data, Abstract 1988.Applicant
- Chen et al., A Distributed OLAP Infrastructure for E-Commerce, Abstract.Applicant
- DSS Lab Comparative Evaluation on Microsoft OLAP Services 7.0 SP1 and Oracle Express 6.3.0.Applicant
- Rahm, Erhard. Dynamic Load Balancing in Parallel Database System, Abstract Proceedings EURO-PAR 96 Conf. LNCS Aug. 1996.Applicant
- Hsiao, David. Federated Databases and Systems: Part I - A Tutorial on Their Data Sharing, Abstract VLDB Journal vol. 1 pp. 127-179 1992.Applicant
- Hsiao, David. Federated Databases and Systems: Part II - A Tutorial on Their Resource Consolidation, Abstract VLDB Journal vol. 2 pp. 285-310 1992.Applicant
- Crystal Decisions. Holos Version 6. Holos Compound OLAP Architecture 2002.Applicant
- O'Neil et al., Improved Query Performance with Variant Indexes, Abstract.Applicant
- Sarawagi, Sunita. Indexing OLAP Data, Abstract. Bulletin of the IEEE Computer Society Technical Committee on Data Engineering 1997.Applicant
- Data Sheet - Informix MetaCube 4.2. Delivering the Most Flexible Business-Critical Decision Support Environments.Applicant
- Technical White Paper - Inside Alphablox Analytics: An In-Depth Technical View of Alphablox Analytics 2004.Applicant
- Ramsak et al., Integrating the UB-Tree into a Database System Kernel, Abstract Proceedings of the 26th VLDB Conference 2000.Applicant
- Stonebraker et al., Mariposa: A Wide-Area Distributed Database System, Abstract.Applicant
- Roussopoulos, Nick. Materialized Views and Data Warehouses, Abstract Proceedings of the 4tH KRDB Workshop Aug. 30, 1997.Applicant
- Bernstein et al., Meta-Data Support for Data Transformations Using Microsoft Repository, Abstract Bulletin of the IEEE Computer Society Committee on Date Engineering 1999.Applicant
- Microsoft SQL Server - Microsoft SQL Server 7.0 Decision Support Services: Lowering the Cost of Business Intelligence 098-80705 1998.Applicant
- Gaede et al., Multidimensional Access Methods, ACM Computing Surveys, vol. 30, No. 2, Jun. 1998.Applicant
- O'Neil et al., Multi-Table Joins Through Bitmapped Join Indices, SIGMOD Record, vol. 24, No. 3, Sep. 1995.Applicant
- Pendse, N. OLAP Omnipresent Byte Magazine Feb. 1998.Applicant
- Zhao et al., On the Performance of an Array-Based ADT for OLAP Workloads, Abstract Aug. 29, 1996.Applicant
- Fiser et al., On-Line Analytical Processing on Large Databases Managed by Computational Grids, Abstract.Applicant
- e-consultancy's website re Oracle Express 6.2 Delivers Unparalleled Intergration, Ease of Use and Platform Support May 29, 1998.Applicant
- Yan et al., Performing Group-By before Join, Abstract. Proceedings of the 10th IEEE Conference on Data Engineering 1994 pp. 89-100.Applicant
- Wu, Ming-Chuan, Query Optimization for Selections using Bitmaps, Abstract.Applicant
- Cheung et al., Requirement-Based Data Cube Schema Design, Abstract.Applicant
- DM Review's website re Analytics Portal: Scalability Stress Test: An Anaylsis of the Scalability of the MicroStrategy and Tandem DSS.Applicant
- Kamp et al., A Spatial Data Cube Concept to Support Data Analysis in Environmental Epidemiology, Abstract 1997.Applicant
- SQL in Analysis Services 2004.Applicant
- Reinwald et al., SQL Open Heterogeneous Data Access, Abstract Proceedings of SIGMOD 98 1998 pp. 506-507.Applicant
- Microsoft's website re Microsoft TechNet. SQL Server 7.0 Resource Guide.Applicant
- Moran, B and K. Watterson SQL Server Savv's website re How to Leverage the Capabilities of OLAP Services Jul. 1999.Applicant
- Radding, Alan. Support Decision Makers with a Data Warehouse, Datamation Mar. 15, 1995.Applicant
- Chapman K. Article from itWorldCanada - Bl/Suite Plays Catch up to Competitors Feb. 26, 1999.Applicant
- MacMillan, M. Article from itWorldCanada - Business Objects 5.0 Dresses Itself up with a Cleaner User Interface Sep. 10, 1999.Applicant
- Article - Hummingbird Acquires Data Transformation Company Leonard's Logic.Applicant
- Article - Business Objects Delivers Next Version of Comprehensive Business Intelligence Suite.Applicant
- Plos Kine, B. Article - Hummingbird Dives Into Business Intelligence (Hummingbird BI Suite) (Product Announcement) Aug. 12, 1998.Applicant
- Printout from Sybase Website “Open ServerConnect Data Sheet”.Applicant
- Printout from Sybase Website Sybase Adaptive Server IQ 12.0.3 with Actuate Reporting System Version 3.2.1, Certification Date: Jul. 1999, Report 150.Applicant
- Printout from Sybase Website “Sybase Adaptive Server IQ 12.03.1 with BusinessObjects Version 5.0, Certification Date: Jul. 1999, Report 148”.Applicant
- Printout from Sybase Website “Sybase Adaptive Server IQ Version 12.0, Sybase DirectConnect for MVS/DB2 11.7 and Sybase Adaptive Server Enterprise 11.9.1 with InfoMaker 7.0, Certification Date: Mar. 1999, Report 137”.Applicant
- Printout from Sybase Website “Sybase Adaptive Server IQ Version 12.0.2 with Hummingbird BI Suite Version 5.0, Certification Date: Mar. 1999, Report 133”.Applicant
- Printout from Sybase Website “Sybase Adaptive Server IQ Version 12.02.2 with Seagate Software Crystal Report and Crystal Info Version 7.0 Certification Date: Mar. 1999, Report 136”.Applicant
- Printout from Sybase Website “Sybase Adaptive Server IQ Version 12.4 with Microsoft Access 2000 Version 9.0, Certification Date: Oct. 1999, Report 155”.Applicant
- Printout from Sybase Website “Sybase DirectConnect for Oracle”.Applicant
- Printout from Sybase Website “Sybase DirectConnect”.Applicant
- Printout from Sybase Website “Sybase IQ Version 11.0 Product Assessment”.Applicant
- Printout from Sybase Website “Understanding Open Server with Customer Success Stories”.Applicant
- Kimball, R and K. Strehlo - “Why Decision Support Fails and How to Fix it,” Datamation, Jun. 1, 1994.Applicant
- TPD (Transaction Processing Performance Council) Interview with Jack Stevens, Francois Raab and Kim Shanley.Applicant
- “The Multimodel, Multilingual Approach to Interoperability of Multidatabase Systems,” David K. Hsiao and Magdi N. Kamel, Departments of Computer and Administrative Sciences, Naval Postgraduate School 1991.Applicant
- “MDD Database Reaches the Next Dimension” Richard Finkelstein, Database Programming and Design, Apr. 1995, vol. 8.Applicant
- “Materialized View and Index Selection Tool for Microsoft SQL Server 2000” Sanjay Agrawal, Surajit Chaudhuri and Vivek Narasayya Proceedings of SIGMOD 2001 May 21-24, 2001 p. 608.Applicant
- “Managing Multidimensional Data: Harnessing the Power” Jay-Louise Weldon, Database Programming & Design, Aug. 1995, vol. 8.Applicant
- “M(DM): An Open Framework for Interoperation of Multimodel Multidatabase Systems” Thierry Barsalou and Dipayan Gangopadhyay 1992.Applicant
- “Help for Hierarchies” Ralph Kimball, Data Warehouse Architect, Sep. 1998.Applicant
- “Beyond Decision Support” Edgar Codd, Sharon Codd and Clynch T. Salley, Computerworld, Jul. 26, 1993 p.87.Applicant
- “A Physical Storage model for Efficient Statistical Query Processing” Wee K. Ng and Chinya V. Ravishankar, Dept. of Electrical Engineering and Computer Science, University of Michigan 1994.Applicant
- Kimball, R. “SQL Is Our Language, Fix It Now” Datamation, Jun. 1, 1994.Applicant
- NetCube “Discussion of NetCube in the Context of IBM's DB2 OLAP Server” Jun. 7, 1997.Applicant
- NetCube Health Care Client - Actual NetCube Model Design; Telecommunications - Business Model Design; Direct Marketing Client - Business Model Design Nov. 1, 2005.Applicant
- NetCube Product Overview (Just-in-Time, not Just-in-Case Business Intelligence, Unleashing the Knowledge in Your Data) Version 1.7;NetCube 1997.Applicant
- NetCube Corporation Milestone and Significant Events.Applicant
- NetCube ROLAPBuilder and CubeOptimizer Overview.Applicant
- NetCube Performance Overview.Applicant
- Erik Thomsen, Dimensional Systems, Remarks from NetCube Product Review on Jan. 14, 1997.Applicant
- An Array-Based Algorithm for Simultaneous Multidimensional Aggregates, Yihoug Zhao, Prassad M. Deshpande, Jeffrey F. Naughton, Computer Sciences Department, University of Wisconsin-Madison.Applicant
- Order of the U.S. District Court for the Northern District of California in the matter of Hyperion Solutions Corp. vs. HyperRoll, Inc. et al. (Case No. CV 05-05054-VRW), 35 pages, Aug. 28, 2006.Applicant