Intelligent storing and retrieving in an enterprise data system

[0001] This application claims benefit of priority of U.S. provisional application Ser. No. 60/822,892 titled “Data Finder Tool Which is Accessible by Remote Clients” filed Aug. 18, 2006, whose inventors are Andreas Peter Haub, Stefan Romainczyk, Ralf Deininger, Helmut Helpenstein, Andreas Krantz, Myrle Krantz, and Eva Wolpers, and is hereby incorporated by reference in its entirety as though fully and completely set forth herein.

[0002] 1. Field of the Invention

[0003] The present invention relates generally to computer software. More particularly, the present invention relates to software for processing measurement data.

[0004] 2. Description of the Relevant Art

[0005] Technical Data Management (TDM) may include a large collection of functionality and operations performed by different applications and services in handling, processing and managing technical data from measurements, from simulations, and from various other technical data processing activities. The applications and services involved in TDM are typically within the operations of an engineering or scientific enterprise, or other organizational entity. The operations may include a wide variety of workflow processes related to technical data, including:

• • [0006] storing and retrieving technical data
  • [0007] exploring, searching and filtering technical datasets
  • [0008] managing and maintaining technical data stores
  • [0009] transmitting technical data to remote users
  • [0010] importing and exporting technical data from foreign systems
  • [0011] supporting network operations for TDM.
    Thus, the operational requirements associated with Technical Data Management represent a very complex organizational problem, whose solution has involved the use of numerous components and technologies, and whose challenge has involved the integration of those components and technologies.

[0012] The field of Technical Data Management (TDM) may specifically include computer-based tools for acquiring, storing, and retrieving measurement data. As used herein, measurement data may represent a type of technical data acquired by a test and measurement application, e.g., via test and measurement hardware, such as data acquisition (DAQ) hardware or other hardware. In TDM involving measurements, it may be useful to store descriptive meta-data, which is associated with a given set of measurement data. One previous method for managing the complexity of TDM measurements has bundled the meta-data and the measurement data to provide self-describing measurement data.

[0013] For example, the Open Data Services (ODS) standard of the Association for Standardization of Automation and Measuring Systems (ASAM) specifies details for representations of the measurement and description data used in the automotive industry. ASAM-ODS generally defines a data model architecture (a method to describe the organization of data in a data store) and general methods to access data stores. An ATF (ASAM Transport Format) file, which is an ASCII representation of the ASAM-ODS data and data model, facilitates the exchange of data between different ASAM-ODS storage systems or other external systems. Measurement data (bulk data) can also be stored in binary files and linked to the ATF file.

[0014] Although the example of ASAM-ODS shows that some degree of standardizing the storage of meta-data among various applications is possible in one industry, there is little historical precedent indicating that any single standard data format, even if it were a self-describing format, could ever be widely adopted. The sheer volume and diversity of existing applications that process measurement data would involve an astronomical task of migration to any one standard, assuming such a standard could ever be agreed upon. Many operators of application programs would experience no benefits from a potential migration, but would incur major costs and disruption of their routine operations. Thus, the present situation, wherein various data formats are used by many different applications, is expected to reflect the future development of TDM.

[0015] Even if a single self-describing data format was adopted, TDM solutions for storing self-describing measurement data may have several drawbacks. For example, in distributed computer systems having multiple networked computers, finding the location of the stored data may be troublesome. In addition, the data format(s) of the stored data may vary or may not adhere to a given standard or policy defined for the organization. Resolving such issues, if at all possible, may often require customized programming for each application accessing the stored data. As customized code becomes increasingly necessary for integrating various components, TDM solutions tend to become systems that are expensive and time consuming to develop, that are difficult to maintain and use, and that do not scale efficiently.

[0016] Various TDM applications (such as those available from National Instruments Corporation) may be used to acquire and store measurements, or retrieve measurements from a data store for analysis and visualization. As noted above, the way TDM is often performed, each application is independently responsible for storing and retrieving data, usually in a different data format. In this type of environment, enterprise applications may concurrently access data stores which contain the measurement data. For example, two applications may access a first data store concurrently, or two applications may each access a different respective data stores concurrently. The various TDM applications can read and write to similar storage mechanisms such as files or databases.

[0017] While it is possible to build TDM solutions with common data stores, current implementations burden the developer of the application (for acquiring, visualizing, and analyzing measurement data) with the responsibility of maintaining a consistent data representation. In these kinds of TDM solutions, the various enterprise applications accessing a given data store must share an understanding of how the measurement data is represented, in turn requiring additional coordination and management effort that must be distributed among a large number of individual applications. As a result, these TDM methods, which involve applications directly accessing measurement data stores, may be difficult to scale across enterprise systems, because the responsibility for coordination and maintenance cannot be centrally enforced in a reliable, cost-effective manner that satisfies all individual requirements.

[0018] Various embodiments are disclosed of a system and method for searching and/or manipulating data in a data infrastructure.

[0019] One embodiment comprises a method for selecting a search value. The method may include receiving first user input specifying first search criteria for desired data (e.g., measurement data). The first user input may be received to a graphical user interface (GUI) and/or using scripts (among other methods). The GUI/script may be included in a data finder tool which includes desired measurement data. The first user input may be used to search meta-data regarding the measurement data. For example, the search criteria may include a property, an operator, and/or a value, e.g., of meta-data associated with the desired measurement data. Thus, the first user input may specify a first property, a first operator, and a first value.

[0020] The method may further include receiving second user input which may specify a first portion of second search criteria for the desired data. Similar to above, the second user input may be received via a GUI and/or a script, among others. The second search criteria may include specification of a second property and/or a second operator. Thus, the second search criteria may be specified by the user and may, in some embodiments, be incomplete.

[0021] Information may be retrieved regarding possible values for a second portion of the second search criteria. The information may be based on the first search criteria and the first portion of the second search criteria. The information may supply possible second values for completion of the second search criteria. In some embodiments, the information may include meta-data of measurement data matching the first and second criteria (or completed portions thereof).

[0022] The information may be displayed to the user, and may be usable to select the second portion of the second search criteria. Thus, the user may be able to select from the possible values to complete the second search criteria. The first and second search criteria may then be used to perform a search, e.g., in the data infrastructure, to locate the desired measurement data.

[0023] One embodiment comprises a method for remotely querying and supplying measurement data, e.g., as specified using the above method.

[0024] The method may include receiving a query over a network for desired measurement data from a remote client. The desired measurement data may include at least a portion of first measurement data which may be stored in a plurality of data files in an enterprise system. Meta-data associated with the first measurement data may also be stored (e.g., with the first measurement data). The meta-data may describe characteristics of the first measurement data, and the query may include parameters of meta-data associated with the desired measurement data.

[0025] An index of the plurality of data files may be searched according to the received query. The index may be organized according to the meta-data.

[0026] The desired measurement data (matching the received query) may be provided over the network to the remote client. Providing the desired measurement data to the remote client may include providing connection information to access the desired measurement data. In other words, the measurement data may be provided to the client by transmitting connection information (e.g., measurement data locations, addresses, passwords, security information, etc.) to the remote client.

[0027] The method may further include providing one or more plug-ins over the network to the remote client which may be usable by the remote client to view the desired measurement data. The plug-ins may be specific to and/or associated with the desired measurement data. In one embodiment, the one or more plug-ins may include all plug-ins associated with the first measurement data (e.g., not just those matching the received query).

[0028] The method may also include providing remote client connection information which may be usable by the client to transmit the query over the network. This connection information may be provided before or after generation of the query at the remote client.

[0029] Receiving, searching, and providing the desired measurement data (and/or the plug-ins) may be performed by one or more computer systems (e.g., servers). The one or more computer systems may be included in a distributed enterprise system and/or a technical management data system (among other systems) as desired.

[0030] One embodiment comprises a method for searching a custom property in a data finder tool.

[0031] The method may include storing an index in a memory medium. The index may include a plurality of base tables (such as the base tables described above) as well as meta-data associated with measurement data. Similar to above, the meta-data may describe characteristics of the measurement data and may include a plurality of base properties (e.g., indexed in the base tables). As also indicated above, the measurement data may be stored in a plurality of data files in an enterprise system.

[0032] A value of a custom property may be stored in a custom property table. The custom property may be at a first level and the custom property table may be at the first level (e.g., of a data structure hierarchy).

[0033] A new column may be created for at least one base table, and the new column may be associated with the custom property. The value of the custom property may be stored in the new column of the at least one base table, and the value of the custom property may be searchable without requiring searching of the custom property table. In one embodiment, after creating the new column, the value of the custom property may be searchable as a base property.

[0034] Creating the new column may include creating a new table for the custom property and merging the new table with the at least one base table to create the new column. The creation of the new column may be performed in response to determining whether searching for the custom property should be optimized. This determination may include receiving user input specifying optimization for the customized property or analyzing the index to determine if the custom property should be optimized.

[0035] In some embodiments, storing the value of the custom property, creating the new column for the at least one base table, and storing the value of the custom property in the new column may be performed without re-indexing the meta-data of the measurement data.

[0036] The method may further include removing the new column from the at least one base table. After removal, the value of the custom property may then be searchable using the custom property (e.g., and not via searching the base table properties). Additionally, similar to above, removal of the new column may not require re-indexing of the meta-data.

[0037] Thus, various embodiments are disclosed of a system and method for searching and/or manipulating data in a data infrastructure.

[0064] While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail. It should be understood, however, that the drawing and detailed description thereto are not intended to limit the invention to the particular form disclosed, but on the contrary, the intention is to cover all modifications, equivalents and alternatives falling within the spirit and scope of the present invention as defined by the appended claims.

[0065] Incorporation by Reference

[0066] U.S. Patent Publication No. 2003/0105811 A1 (Ser. No. 10/137,669) titled “Networked Data Stores for Measurement Data,” filed May 2, 2002, whose inventors are Guy Vachon Laborde, David M. Pierce, Andreas Peter Haub, Stefan Romainczyk, and Helmut J. Helpenstein; U.S. Patent Publication No. 2003/0061195 A1 (Ser. No. 10/137,717) titled “Technical Data Management (TDM) Framework For TDM Applications,” filed May 2, 2002, whose inventors are Guy Vachon Laborde, Andreas Peter Haub, Stefan Romainczyk, and Helmut J. Helpenstein; and U.S. Patent Publication No. 2003/0154192 A1 (Ser. No. 10/137,723) titled “Optimized Storage for Measurement Data,” filed May 2, 2002, whose inventors are Guy Vachon Laborde, David M. Pierce, Andreas Peter Haub, Stefan Romainczyk, and Helmut J. Helpensteinare hereby incorporated by reference in their entirety as though fully and completely set forth herein.

[0067] Computer System Platform

[0068] A representative hardware platform for practicing the methods described herein is depicted in FIG. 1, which illustrates an exemplary hardware configuration of a computer system 101. The computer system 101 may execute computer programs which may be stored on volatile or non-volatile memory. In various embodiments, the computer system 101 may comprise a desktop computer, a laptop computer, a palmtop computer, a network computer, a personal digital assistant (PDA), an embedded device, a smart phone, or any other suitable computing device.

[0069] The computer system 101 includes at least one central processing unit (CPU) or other processor(s) 110, such as a conventional microprocessor, and a number of other units interconnected via system bus 112. The CPU 110 may include other circuitry not shown herein, which will include circuitry commonly found within a microprocessor, e.g., execution unit, bus interface unit, arithmetic logic unit, etc. The CPU 110 may be coupled to a memory medium, which may include random access memory (RAM) 114, read only memory (ROM) 116, and input/output (I/O) adapter 118 for connecting peripheral devices. The peripheral devices to adapter 118 may include smart sensor devices, (e.g., configurable I/O devices, field point devices such as those provided by National Instruments Corporation, among others, etc.) disk units 120, tape drives 140, optical drives 142 which may be connected via peripheral bus 119 to main bus 112, in one embodiment. The CPU 110 may be configured to execute program instructions which implement the system and methods described herein.

[0070] As used herein, the term “memory medium” includes a non-volatile medium, e.g., a magnetic medium, hard disk, or optical storage; a volatile medium, such as computer system memory, e.g., random access memory (RAM) such as DRAM, SDRAM, SRAM, EDO RAM, Rambus RAM, etc.; or an installation medium, such as CD-ROM, DVD-ROM, floppy disks, or a removable disk, on which computer programs are stored for loading into the computer system. The term “memory medium” may also include other types of memory. The memory medium may therefore store program instructions and/or data which implement the methods described herein. Furthermore, the memory medium may be utilized to install the program instructions and/or data.

[0071] In a further embodiment, the memory medium may be comprised in a second computer system which is coupled to a first computer system through a network. In this instance, the second computer system may operate to provide the program instructions stored in the memory medium through the network to the first computer system for execution.

[0072] The data processing network 144 may be a wireless, galvanic wired, or optical media network with a star, ring, or other topology. The network 144 may be representative of various types of possible networks: for example, a local area network (LAN), wide area network (WAN), or the Internet. The systems and methods described herein may be implemented in various embodiments on a plurality of heterogeneous or homogeneous networked computer systems, such as exemplary computer system 101, through one or more networks.

[0073] In various embodiments, the CPU 110 may also be coupled through an input/output bus 112 to one or more input/output devices via one or more adapters. Thus, computer system 101 also may include user interface adapter 122 for connecting keyboard 124, mouse 126, and/or other user interface devices such as a touch screen device (not shown) to bus 112. Further included in computer system 101 may be communication adapter 134 for connecting data processing bus 112 to a data processing network 144, and display adapter 136 for connecting bus 112 to display device 138.

[0074] Yet further included in computer system 101 may be multimedia adapter 150 for connecting bus 112 to microphone 152 and loudspeaker system 154; other types of multimedia output and input devices, such as headphones and stereo speakers (not shown), may be used via analog or digital interfaces with adapter 150. In various embodiments, computer system may also include a track ball, a magnetic or paper tape reader, a tablet, a stylus, a voice recognizer, a handwriting recognizer, a printer, a plotter, a scanner, and any other devices for input and/or output.

[0075] Distributed Computing Environment

[0076] FIG. 2 illustrates a distributed or enterprise computing environment 200 according to one embodiment. An enterprise 200 may include a plurality of computer systems, such as computer system 101, which are interconnected through one or more networks. Although one particular embodiment is shown in FIG. 2, the enterprise 200 may comprise a variety of heterogeneous computer systems and networks which are interconnected in a variety of topologies and which run a variety of software applications.

[0077] One or more local area networks (LANs) 204 may be included in the enterprise 200. A LAN 204 is a network that spans a relatively small area. Typically, a LAN 204 is confined to a single building or group of buildings. Each node (i.e., individual computer system or device) on a LAN 204 preferably has its own CPU with which it executes computer programs, and often each node is also able to access data and devices anywhere on the LAN 204. The LAN 204 thus allows many users to share devices (e.g., printers) as well as data stored on file servers. The LAN 204 may be characterized by any of a variety of types of topology (i.e., the geometric arrangement of devices on the network), of protocols (i.e., the rules and encoding specifications for sending data, and whether the network uses a peer-to-peer or client/server architecture), and of media (e.g., twisted-pair wire, coaxial cables, fiber optic cables, radio waves). FIG. 2 illustrates an enterprise 200 including one LAN 204. However, the enterprise 200 may include a plurality of LANs 204 which are coupled to one another through a wide area network (WAN) 202. A WAN 202 is a network that spans a relatively large geographical area.

[0078] Each LAN 204 comprises a plurality of interconnected computer systems or at least one computer system and at least one other device. Computer systems and devices which may be interconnected through the LAN 204 may include, for example, one or more of a workstation 210a, a personal computer 212a, a laptop or notebook computer system 214, a server computer system 216, or a network printer 218. An example LAN 204 illustrated in FIG. 2 comprises one of each of these computer systems 210a, 212a, 214, and 216 and one printer 218. Each of the computer systems 210a, 212a, 214, and 216 may be an example of computer system 101, as illustrated in FIG. 1. The LAN 204 may be coupled to other computer systems and/or other devices and/or other LANs 204 through a WAN 202.

[0079] A mainframe computer system 220 may optionally be coupled to the enterprise 200. As shown in FIG. 2, the mainframe 220 is coupled to the enterprise 200 through the WAN 202, but alternatively the mainframe 220 may be coupled to the enterprise 200 through a LAN 204. The mainframe 220 is coupled to a storage device or file server 224 and mainframe terminals 222a, 222b, and 222c. The mainframe terminals 222a, 222b, and 222c access data stored in the storage device or file server 224 coupled to or comprised in the mainframe computer system 220.

[0080] The enterprise 200 may also comprise one or more computer systems which are connected to the enterprise 200 through the WAN 202: as illustrated, a workstation 210b and a personal computer 212b. In other words, the enterprise 200 may optionally include one or more computer systems which are not coupled to the enterprise 200 through a LAN 204. For example, the enterprise 200 may include computer systems which are geographically remote. In one embodiment, the Internet may be included in WAN 202.

[0081] It is noted that one or more computer systems, as described in FIG. 1 or 2, may couple or connect to a measurement device or instrument that acquires measurement data from a device, UUT, or process. For example, measurement data may be generated by a measurement device (such as a data acquisition device), by an instrument or by an interface to a bus system hosting various devices or instruments. In this manner, the collected measurement data may be ultimately deposited in a data store and made available to any number of applications processing the measurement data in the enterprise system 200.

[0082] Technical Data Management Framework

[0083] FIG. 3 illustrates a diagram for a 3-tier Technical Data Management (TDM) framework, in one embodiment. The TDM framework may include various components for managing the storage and retrieval of technical data (such as measurement data) in an enterprise system 200. The organization of the TDM framework in an enterprise system, shown in one embodiment in FIG. 3, is based on 3 tiers, or layers of functionality: application layer 302, tools layer 304, and storage layer 306. Each of these layers will be described in detail below. The enterprise system may collectively refer to a collection of applications 302, tools 304, and storage 306, including any required infrastructure and services, that are deployed across an enterprise or other organizational structure. In one embodiment, a TDM framework is operable on an enterprise distributed computing environment 200.

[0084] The application layer 302 includes the individual applications which may process measurement data in an enterprise system. The application layer 302 may include a plurality of individual application programs which process measurement data. As shown in FIG. 3, in one embodiment, TDM applications from National Instruments Corporation (DIAdem 302a, and LabVIEW 302b) may be used to acquire and store measurements, or retrieve measurements from a data store for analysis and visualization. In one example application, an organization performs tests on various devices, e.g., for quality control or R&D purposes, and the results of the tests may include measurement data. In other embodiments, applications in layer 302 may include commercially available software products from various vendors, or customized applications developed within an enterprise or industry.

[0085] In one embodiment, individual applications in layer 302 may access the same technical data for various purposes. For example, a first application may use data acquisition hardware to acquire waveform data from the devices, compute RMS and peak information from the data, and store the results. A second application may search for particular data sets that have been stored, perform further analysis on the data sets, and then re-store the data.

[0086] The tools layer 304 includes the TDM infrastructure for providing services and interfaces, that allow applications in application layer 302 to access resources in storage layer 306. It is noted that tools layer 304 may further include application-specific interface modules, such as indexing service 310, which, in one embodiment, provides access to measurement data by indexing meta-data, as will be described in detail below.

[0087] The functionality included in one embodiment of TDM infrastructure 320 may include modules operable to store 321 and extract 322 data from the storage level 306. It is noted that TDM infrastructure may also be referred to as a type of Universal Storage Interface (USI). The store 321 and extract 322 functions may further rely upon a data cache 326 for buffering data going into or coming from storage layer 306.

[0088] It is further noted that a data cache 326 may be implemented in various embodiments in different kinds of volatile or non-volatile memory, or any number of combinations thereof. The data cache 326 may provide performance enhancement by caching technical data in a variety of ways. In one embodiment, the data cache 326 stores the most recently accessed (stored or extracted) data, in order to reduce access times for subsequent operations involving the same data. In another embodiment, the data cache 326 may reduce or eliminate the number of accesses to a particular data file, by fetching meta-data and/or some portion of the data file, such that applications 302 are not required to access the data file itself for browsing or querying the file. In other embodiments, the data cache 326 may be coupled to indexing service 310 and store indexed information on measurement data files. Applications, such as the Diadem 302a and LabVIEW 302b applications shown in FIG. 3, may utilize any of the storage mechanisms supported by the TDM framework simply by utilizing the provided data cache 326 interface.

[0089] The interfaces provided by the TDM framework may allow for the storage and retrieval of data without regard to the storage mechanism (i.e., the type of data store actually accessed in storage layer 306). In other words, the TDM framework may hide differences in the various types of data stores, along with the complexity of the different access mechanisms, from the user/application accessing the data. The same access methods may be used no matter what data store actually stores the data. It is noted that this property of the TDM framework effectively encapsulates the management of various data stores within the TDM framework, and thereby centralizes TDM within the enterprise system 200. Note that the concept of centralization in the presently described methods is virtual and logical, referring to unified services and management responsibilities; the actual physical location of the data stores, applications, and TDM infrastructure may be distributed across the enterprise, or even be at a remote location.

[0090] The TDM infrastructure 320 may further include storage-specific plug-ins, which interface to a given type of storage via the data cache 326. In one embodiment, separate plug-ins for databases 328a, files 328b, and network data 328c may be included in the tools layer 304. In another embodiment, a separate plug-in 328 is installed for each type of individual data store, for example, a given data file format. A method for selecting a plug-in for indexing a particular type of data store, in one embodiment, is discussed in detail below (see FIG. 7). In one embodiment, a plug-in 328 may interface with an indexing service 310 for transferring meta-data and measurement data from a measurement data file (see FIG. 18). The types of data stores supported by the TDM framework can be expanded as necessary by adding new plug-ins, corresponding to new types of data stores.

[0091] Referring now to FIG. 18, the relationship and function of a plug-in 328 is illustrated. A measurement data file 480 is stored including meta-data 482 that describe the measurement data. A plug-in 328 extracts data and meta-data 482 from the data file 480. In one example implementation, a plug-in 328 extracts meta-data 482 and stores these in an index 484, which may be used to browse or query the data file 480, without having to open and read the data file. The indexing operation may be performed upon introduction of the data file 480 or upon installation of the plug-in 328, or may be repeated at a later time, for example, at a regular interval, or in response to an indication of an update to the data file. One example of an indexing operation is described below with respect to FIG. 6. In one example, the plug-in 328 may read in the attributes from any previously stored arbitrary, binary, or ASCII file into the data index for searching custom file formats and legacy data.

[0092] Referring again to FIG. 3, additional functions in the tools layer 304 may include data model configuration 323 and data management functions 324. In one embodiment, these functions are included in the basic TDM infrastructure 320 and rely upon the data cache and plug-in architecture for accessing data. In other embodiments, these functions may represent administrative tools that are performed as required, for example, according to enterprise policy. It is noted that the implementation of the TDM framework, as shown in FIG. 3, may be accompanied by a user and administrator policy within the enterprise, which conveys the authorization to the TDM framework for providing access and management of data stores 306. The implementation of the policy may include providing (or restricting) access, depending on the individual data store and administered user rights. In one embodiment, the data management functions 324 may also include enforcement of digital rights policies associated with a particular data store.

[0093] Security may be enforced throughout the TDM framework to limit access to the technical data. In one embodiment, the security model may be compatible with the security defined in the ASAM-ODS specification and may be similar in design. The security model may also be compatible with security concepts utilized by various applications that utilize technical data, e.g., LabVIEW DSC, Lookout, etc.

[0094] In one embodiment, the security model may be built around users, user groups, and an access control list (ACL). Individual users may be defined and given a unique password. Users may be assigned to one or more user groups. User groups may be defined as is appropriate in individual applications, projects or organizations. The ACL assigns access rights for individual user groups to specific data objects (data items) in the data store. For a user group/data object pair, specific access rights may be defined in one entry of the ACL.

[0095] In some embodiments, specific data models and/or data stores may choose not to implement security, so that their data is accessible to all users. For example, data stores based on files may typically not implement security. However, formats such as ATF may be able to store the security information in a data model.

[0096] According to one exemplary embodiment, access rights can be granted at three different levels in the data model, as follows:

[0097] 1. Application Element—An application element in the data model is assigned an access right in the ACL. All instances of this application element have the same access rights and need no individual entries in the ACL. This is appropriate for many small and medium size applications where defined groups of users have access to all instance of a particular type.

[0098] 2. Instance Element—Individual instance elements are given access rights in the ACL. This is appropriate for large data storage system where data from different groups or projects are sorted in the same data model, and access rights need to be differentiated between different groups at the instance level.

[0099] 3. Application Attribute—Access can also be given at the application attribute level, such that groups will have access to specific attributes on all instances of an application model. Such specific groups can access the attributes appropriate to them.

[0100] Alternatively, if none of these three access rights is defined, then if the instance has a parent instance with access rights defined, they may be copied to the child.

[0101] According to one embodiment, the ACL may assign five different access rights to a user group for a specific data object. These are: Read, Update, Insert, Delete and Grant. Some of these access rights do not apply to some of the access right level listed above and may be ignored by a data store.

[0102] Read—The user group is able to read the data object.

[0103] Update—The user group is able to update/edit the data object.

[0104] Insert—The user group is able to insert/add a new data object of the given type.

[0105] Delete—The user group is able to delete the specified data object.

[0106] Grant—The user group is able to grant/pass on its own rights for a specific data object to another user group.

[0107] Most of the functionality required for security is part of a data store implementation to limit access to data and manage the information in the ACL. The different interfaces and components between an application and the data store may pass security information from the application to the data store, such as the user name and password, and may pass information about access rights for new data objects to the data store so that they can be stored in the ACL. Additionally, security management information may be passed from a separate tool to the data source. Security management may be performed locally to the data source, or remote security management may be possible, e.g., may be handled through the data cache 326 or by a data cache server.

[0108] Although the security information is normally stored in the application data model, user and user group management may be performed in various embodiments using a separate tool or component to edit this information. Additionally this tool may be used to directly manipulate the ACL when incorrect information is present. In some embodiments, security information may not be accessible through the regular data storage functions. Management of user information may be limited to one user group, which is designated as a “Superuser” group (i.e., system administrators). In one implementation, this group can never be empty and only members of this group can add new members to this group.

[0109] In one embodiment, data management functions 324 may include various functions related to the management of multiple data stores. For example, the data management functions 324 may allow a user or client application to delete entries from a data store or move or copy data store entries. The TDM framework may also support mapping or copying data entries from one data store to another data store. In one embodiment, when different data stores use different data models, a client application may be responsible for mapping the data from one model to another. In another embodiment, automatic conversion between the data models may be supported. The user may need to supply information specifying how the conversion is to be performed. For example, the user may utilize a tool to specify mapping points in the two data models, provided by TDM infrastructure 320.

[0110] In one embodiment, the TDM framework may also support automatic synchronization/replication between multiple copies of the same data store. For example, when a change to one of the copies is made, the other copies may be automatically updated to reflect the change. The synchronization/replication process may be bi-directional. Each data store may reflect the complete and most up to date status after the synchronization/replication. Updates may be performed with each change or at regular intervals.

[0111] A unidirectional process to import new data from a remote data store to a network master data store may also be supported in certain embodiments. This may be useful in a portable application where data is acquired on a disconnected computer to a local data store, and then imported to the network master data store when the computer is reconnected to the network. The disconnected computer may or may not receive data from the master data store which came from other client systems, or may receive such data on demand.

[0112] The TDM framework may utilize data models to support the concept of self-describing measurement data. A data model may define a structure of data items, their attributes, and relationships between different data items. In one embodiment, the data model configuration 323 and data management 324 functions may be used to configure and manage information relating to a data model, such as meta-data.

[0113] Information describing the data model is called meta-data. The meta-data in the data model give meaning to the actual stored data by specifying what the data represents. It is often useful to explicitly state and store the data model used by a particular application, especially in larger applications or where the data is used by multiple applications. An application or user unfamiliar with the data can apply the meta-data to properly interpret the data.

[0114] In one embodiment, the TDM framework may enable users to define and use their own data models using meta-data. Defining a data model by storing meta-data with the measurement data may impart a self-describing quality to a particular data store. For example, if channel or trace data can be recognized as an entity that includes bulk waveform data, applications that use the channel or trace data can offer adapted methods to deal with this waveform data, e.g., to display it in a diagram. The meta-data may also make it easier to keep measurement data consistent, by providing examples and historical records of previously acquired measurement data. In one example, the meta-data in an existing data store may be reused as a template, or may be adapted for storing a similar or related measurement.

[0115] The term data model architecture refers to the structure of a valid data model, whereas meta-data represent the implementation on a particular data model. The data model architecture may define the pieces of a data model, and how the different pieces can be linked or joined into a data model. Note that knowledge of the data model architecture is not required for accessing (e.g., indexing, browsing, querying) measurement data using the methods described herein; the TDM framework, including meta-data, provides the necessary information for accessing measurement data. In one embodiment, instructions relating to the interpretation of a particular data model architecture are implemented in a plug-in, which directly accesses a measurement data file to retrieve meta-data and measurement data stored according to that data model.

[0116] In various embodiments, the data models utilized by the TDM framework may be implemented according to any of various data model architectures. According to one embodiment, the meta-data includes two parts, the base model and the application model, which is derived form the base model. The base model describes the basic elements of a data source or data store. It may also include elements to describe measurement data, administrative information, units, dimensions, and provisions for any application-specific data. The application model is derived from the base model and describes the specific elements of the data model for a particular application. The base model serves as a general guideline for how application models in a group of applications should be setup. However, the application model defines the data model for each individual application.

[0117] In other embodiments involving measurement data, the data model may represent a hierarchical data model, for example, a TDM data model. In one embodiment presented in detail below, a TDM data model comprises a 3-level hierarchy of meta-data, including: a file/root level; a group/type/setup level; and a signal/channel/trace level. Each of these levels in the hierarchical data model may be associated with its own kind of meta-data for describing that level, as described with the following examples, which correspond to the illustration in FIGS. 4A and 4B. FIG. 4A shows a specific example of a more general hierarchical TDM data model illustrated in one embodiment in FIG. 4B. In one exemplary embodiment, a TDM data model involves splitting the measurement information (i.e., measurement data) and attribute information (i.e., meta-data) into separate files, one that contains all the measurement data in a binary form and an XML header to manage the structure and attributes. This combination of binary and XML may provide significant advantages for portable, flexible, and search ready TDM data files. In various other embodiments (not shown), a hierarchical model of data using different numbers of levels and organizations may be used with the methods described herein.

[0118] In some embodiments, the highest level 412 in the hierarchical model is the file/root level, which may include meta-data for one or more of the following aspects related to the storage of a measurement data file:

• • [0119] timestamp information for the measurement data
  • [0120] owner of the measurement data
  • [0121] name of the file/root
  • [0122] type of the file/root
  • [0123] format of the file/root
  • [0124] path/location of the file/root.
    One example of the file/root level is shown by the TEST field 402, which includes the data, owner and file information.

[0125] In some embodiments, the middle level 414 in hierarchical model is the group/type/setup level, which may include meta-data for one or more of the following aspects related to the organization of the data in a measurement data file:

• • [0126] type of measurement of the group/type/setup
  • [0127] description of the type of measurement
  • [0128] operator of the group/type/setup
  • [0129] recommended type of analysis/post-processing for the group/type/setup
  • [0130] reference to another document describing the measurement setup/channel list in the group/type/setup
  • [0131] measurement setup/channel list in the group/type/setup
  • [0132] sample rate for group/type/setup.
    One example of the group/type/setup level is shown by the MEASUREMENT field 404, which includes the sample rate, start time and operator of the measurements in a setup.

[0133] In some embodiments, the lowest level 416 in hierarchical model is the signal/channel/trace level, which may include meta-data for one or more of the following aspects related to an individual channel or signal of data in a measurement data file:

• • [0134] name of the signal/channel/trace
  • [0135] engineering unit for the signal/channel/trace
  • [0136] description of the engineering unit
  • [0137] description of the signal/channel/trace
  • [0138] unique ID for the signal/channel/trace
  • [0139] unique ID for the sensor/transducer measuring the signal/channel/trace
  • [0140] an image of the signal/channel/trace
  • [0141] a set of data points included in the signal/channel/trace.
    One example of the signal/channel/trace level is shown by the CHANNEL field 406, which includes the name, unit and data for one or more channels of measurement data.

[0142] The TDM framework may also include various utilities to search, view, or analyze technical data (not shown in FIG. 3). These utilities may utilize the underlying interfaces provided by the TDM framework. The TDM framework may also provide a set of user interface components.

[0143] In various embodiments, the TDM framework may allow applications to register to be notified when changes occur to a particular data item. When two or more applications access the same data, the TDM framework may control write access from these applications on the data. In some embodiments, simultaneous write access by multiple applications may be allowed. In these implementations, the TDM framework manages the access and maintains a consistent state in its cached data and the data store.

[0144] As will be described in further detail below, the TDM framework and the methods described herein may simplify technical data management tasks by providing a common data retrieval and storage interface for applications to use for managing diverse collections of technical data. It is further noted that embodiments of the methods described herein do not require introducing non-standard, customized code in the enterprise 200, for enabling interoperability among different applications. Instead, a plug-in architecture and a centralized indexing service provide the ability to accommodate various types of stored data at different locations from a unified TDM framework.

[0145] Referring to FIG. 5, a method 500 for processing measurement data is illustrated in one embodiment. It is noted that in various embodiments, the method 500 may be performed by the TDM infrastructure 320 on a computer system 101 for accessing measurement data within the enterprise system 200.

[0146] In step 502, measurement data may be stored in an enterprise system 200 in one or more data files. Along with the measurement data, meta-data associated with the measurement data may also be stored in step 502. The meta-data describe characteristics of the measurement data. In some embodiments, the meta-data describe all aspects of the measurement data required for accessing the measurement data. For example, a plurality of data files are stored in step 502. The data files may be generated in one embodiment by an application program 302 which stores the measurement data at a location within the enterprise system 200.

[0147] The one or more data files stored in step 502 may be designated with a file type designation which corresponds to the data format of the file. For example, a file type of .txt corresponds to a text file. The data format and/or the contents of the file may represent a specific file type. The file type may be associated with a given application program, for example: the file type “.xls”, which is generally associated with Microsoft Excel. It is noted that a given file type may be associated with one or more applications, and more than one application may be able to process any given file type, as will be described in more detail below.

[0148] In one embodiment, the data files may be stored in step 502 using the store function 321 of a TDM framework, for example, by using a standard user interface for defining the measurement data, meta-data and location of the data file. In one instance, the standard user interface is provided by TDM infrastructure 326, for example, by the store 321 and/or data management 324 functions. The location of the data files may be determined by the user or determined by enterprise policies, which may depend upon file type, user access, application program requirements, workflow requirements, or other factors.

[0149] In step 504, an index of a portion of the files may be created according to the meta-data associated with each portion of measurement data, according to some embodiments. In one embodiment, step 504 is performed by indexing service 310 using plug-ins, as will be described in detail below, which are respectively associated with each of the files. In various embodiments, upon completion of step 504, at least some portion of measurement data in one or more files is indexed and ready for access by applications within the enterprise via the TDM infrastructure 320.

[0150] Continuing with the method shown in FIG. 5, two separate options are illustrated for processing measurement data indexed in step 504: browsing and querying. Although these method steps are shown as parallel steps in FIG. 5, in various other embodiments, browsing and querying may be intermingled and performed interactively, as desired.

[0151] In step 506, user input for browsing at least one first data file is received, according to some embodiments. The TDM infrastructure 326 may further include a user interface for displaying a hierarchical view which contains at least a subset of the plurality of indexed data files, as described above. In one embodiment, the user input comprises user input to the hierarchical view of data files in the enterprise system 200. The user input may include expanding and collapsing elements of the hierarchical view, representing a hierarchical data store, wherein each level is a directory or folder in a file system, which may contain further directories and/or data files. In some embodiments, the hierarchical view corresponds to a hierarchical data model, wherein meta-data describe the various levels in the hierarchy, as mentioned previously.

[0152] In various embodiments, in step 508 a query for measurement data, including parameters of meta-data associated with the measurement data may be received. In one embodiment, the query is a structured statement, for example, similar to an SQL Select statement. The query may be issued by a user interactively, or by another application or service, which is requesting automated access to a selected portion of measurement data. In step 509, the results of the query may be retrieved from one or more data files. In various embodiments of step 509 (see also FIG. 9), a plug-in associated with each data file from which query results are retrieved may be used to retrieve measurement data from the data file.

[0153] In step 507 of FIG. 5, measurement data selected by browsing (step 506) or by querying (steps 508, 509) may be displayed. In one embodiment, measurement data may be retrieved from the data file during step 507, for displaying, either in a table or a graphic, the selected measurement data. In other embodiments, the indexing service 310 has stored a portion of the measurement data along with (or included within) the meta-data stored in the index. For example, in various embodiments, a finite number of measurement points in a measurement data file containing signal trace information are automatically retrieved during indexing, and used to display selected measurement data for that file. In certain instances, a given number of data points, for example 1,000 data points, are retrieved from the beginning of each channel measurement for indexing. In other cases, the representation of a signal trace for a channel over a collection period are reduced to a fixed number of data points, for example 1,000 data points, for inclusion in the index. Other amounts of data and indexing schemes may be alternatively used in various embodiments, including storing meta-data and measurement points in data cache 326.

[0154] Referring now to FIG. 6, an embodiment of step 504 is described in further detail in method 504a, which illustrates an exemplary method for indexing a measurement data file using the indexing service 310. In step 540, the extension of the measurement data file is examined. Based on the file extension, the method may register which plug-in is associated with the file (step 542; see also FIGS. 7 and 10). The registered plug-in may then be used to extract meta-data from the measurement data file (step 544). In one embodiment, the extracted meta-data may be added to a database index (step 546) and a text index (step 548). The database index of meta-data provides the ability to query indexed measurement data according to parameters of meta-data associated with the measurement data. The text index of meta-data provides the ability to search measurement data based on any textual information in the meta-data.

[0155] Referring now to FIG. 7, an embodiment of step 542 is described in further detail in method 542a, which illustrates an exemplary method for selecting and registering a plug-in for a data file. In one exemplary implementation, method 542a is performed by indexing service 310 each time a new data file is introduced to storage layer 306. Since the file extension for the given data file has been examined in step 540, the first step in method 542a involves identifying one or more plug-ins that are associated with the file extension (step 530). Using a selected plug-in, an attempt is made to extract meta-data from the data file (step 532). The results of the attempted extraction are retrieved using the selected plug-in (step 534). A determination is made, whether or not an error has occurred during extraction (step 535). If no error has been made, then the selected plug-in may be assumed suitable for accessing the data file (i.e., the plug-in contains the correct hierarchical data model architecture for extracting meta-data from the file). In that case, where the determination of error in step 535 is negative, the selected plug-in may be associated with the data file (step 536).

[0156] In various embodiments, the association may further involve registering the plug-in and/or data file as being associated. If the determination of error in step 535 is positive, then the method may loop back to step 532, and select another plug-in for an attempted extraction. Using this iterative manner in some embodiments, the correct plug-in for the data file may be selected. It is noted that the method 542a may also be used in other embodiments to identify or verify a certain type of data file, if the selected plug-in is known to correspond to that type of data file. It is also noted that the method steps for selecting and indexing a data file involve reading the contents of the data file, whereas subsequent browsing and querying operations may not require accessing the data file.

[0157] In other embodiments, the method described herein for selecting a plug-in may also result in more than one plug-in being associated with a given data file, wherein each associated plug-in was successfully able to read the meta-data in the data file. The actual choice of an active plug-in may be made subsequent to selecting each of the more than one plug-in, for example, in response to subsequent user input.

[0158] Referring now to FIG. 10, an alternative embodiment of step 542 is described by method 542b. It is noted that corresponding functions from FIG. 7 are numbered identically. In step 538, the selected plug-in is associated with the data file type, as determined by the file extension in step 530.

[0159] The browsing function in step 506 may also include displaying non-measurement data files (i.e., ordinary files in a data store) and optionally meta-data associated with the non-measurement data. Referring now to FIG. 8, a method 506a in one embodiment of step 506 is illustrated in further detail. In method 506a, the browsing function may display ordinary files and indexed meta-data for measurement data files in a unified display (step 560). In one example, the display may take the form of a collapsible tree structure, commonly referred to as an explorer (see description below regarding FIG. 11). It is noted that the distinction between data files, and indexed meta-data, which describe the contents of a measurement data file, may be made transparent to the user during browsing in step 506. In other words, the browsing function in step 506 may provide access to ordinary files and indexed measurement data files, including access to individual meta-data, in a single unified user interface, within the same hierarchical view.

[0160] In response to user input, the hierarchical structure of the meta-data in the file may be displayed. In one embodiment, an indexed version of the meta-data is used for browsing, such that displaying the hierarchical structure of the meta-data in the file does not require opening the file (step 562). Further in response to user input, method 506a may provide selection of measurement data channels, groups of channels, or entire files (step 564).

[0161] Referring now to FIG. 11, a portion of a user interface showing a unified hierarchical view of data folders, data files and measurement data (represented by meta-data) is illustrated in one embodiment. A hierarchical collection of data folders 602 (i.e., directories, registers etc.) may represent the location and ordering of data in a data store. Each data folder may contain other data folders or data files 604. The data files 604 may be non-measurement or measurement data files. In the case of measurement data files 604 that have been previously indexed, the contents of any data file may also be displayed for browsing. For example, a data file may contain one or more measurements 606, which may be revealed upon expanding a data file 604. Any one of the measurements 606 may further be expanded to reveal one or more individual data channels 608. Note that the measurements 606 and channels 608 may be displayed with their actual meta-data descriptive values. It is also noted that in one embodiment, the browsing into a measurement data file does not require that the data file itself be opened, but rather, meta-data are retrieved from an index to enable browsing. It is further noted that in various embodiments, the hierarchical view shown in FIG. 11 may correspond to the TDM hierarchical data model illustrated in FIG. 4B, as described above. In particular, data files 604 may correspond to the file/root level 412; measurements 606 may correspond to the group/type/setup level 414; and channels 608 may correspond to the signal/channel/trace level 416.

[0162] A unified hierarchical display according to the presently described features as shown in FIG. 11 may appear to a user browsing the display to operate as if measurements 606 and channels 608 were available as data folders or data files in any other part of the hierarchy. In particular, measurement data files 604 and measurements 606 may appear to have attributes of data folders, being further expandable to reveal their respective contents within the explorer or other browsing user interface. In one embodiment, the browsing interface may be a text-based command prompt, requiring explicit commands for listing or navigating the hierarchy.

[0163] Note that in some embodiments, the displayed information (e.g., the indexing information/meta data) may be updated “on the fly” during browsing. In other words, the information viewed by the user (e.g., using the browser of described herein) may be identical to the current content of the file system. Correspondingly, the user may not have to double check, e.g., using normal file system explorers, the accuracy of the displayed information. This “on the fly” updating may be used for both local and remote connections as desired.

[0164] Referring now to FIG. 9, an embodiment of step 509 is described in further detail in method 509a, which illustrates an exemplary method for retrieving query results. In one exemplary implementation, method 509a may be performed by indexing service 310 each time a query is issued for retrieving measurement data. In step 590, the index is searched according to the query, such that either the database index or the text index or both are searched. In step 592 a determination is made if there is a match in the index that corresponds to the parameters of the query. In other words, it is determined if the search 590 found indexed meta-data corresponding to the parameters of meta-data in the query. If the determination in step 592 is negative, then in step 594 an empty result is returned, and method 509a may end. If the determination in step 592 is positive, then the file parameters for each queried file (i.e., each file whose meta-data matched the query) are determined in step 596. In one example, the file parameters may include the file extension, file type, and location of the file (i.e., the file path). In step 598, the registered plug-in for accessing each queried file is selected. Then, in step 599, measurement data corresponding to the query are retrieved using the selected plug-ins.

[0165] The following brief descriptions describe exemplary usage scenarios, in different embodiments, in which various applications may utilize the technical data management (TDM) framework to store/access technical data.

[0166] A data acquisition application may utilize the TDM framework to store waveform or other bulk data. The waveform data may be streamed from the application to the TDM framework using a streaming interface. The TDM framework may store the waveform data in file(s) (or databases as desired) specialized for storing waveform/bulk data. In one embodiment, attribute data associated with the waveform data may be stored in a different file and/or database, e.g., a relational database.

[0167] A graphical programming development environment may utilize the TDM framework to store and retrieve data associated with graphical programs. For example, the graphical programming development environment may store/retrieve front panel data using the TDM framework. The graphical programming development environment may also store/retrieve block diagram data using the TDM framework.

[0168] A test executive software application may utilize the TDM framework to store execution results of test executive sequences, e.g., measurement data indicating results of executing various tests on a unit under test (UUT).

[0169] A technical data analysis application may utilize the TDM framework to retrieve previously stored measurement data. Meta-data stored with the measurement data may be utilized by the analysis application to give a meaning to the measurement data. After processing the data, the analysis application may utilize the TDM framework to store the results of the analysis.

[0170] It is noted that these applications are exemplary only, and the TDM framework may be utilized by any of various other types of applications to manage technical data. Also, the TDM framework may serve as a common data storage/retrieval mechanism that integrates various applications. For example, the technical data analysis application in Example 4 may utilize the TDM framework to retrieve and analyze data previously stored by one of the other applications.

[0171] User Interface Components

[0172] In some embodiments, a user interface component may allow various applications to easily display a user interface showing the data model and/or contents of a data store. Various aspects of a browser component providing this functionality in some embodiments are described below. A user interface component may also be used to select items from a data store for loading or other processing. Additional user interface components may be available for performing other tasks, such as configuring security management, configuring networked data stores, etc.

[0173] The user interface components may be activated through a number of different interfaces in various different embodiments, for example, as separate ActiveX controls. The user interface components may also utilize a lower-level interface, such as a programming command interface.

[0174] FIG. 12 illustrates an exemplary graphical user interface for a browser control. The user interface of the browser control is laid out as a navigator window 620. An explorer structure 624, with a tree view of a hierarchically organized data store and its contents may be displayed by selecting the browsing function 622 in the navigator (see also FIG. 11). The tree view displays the structure of the data store (data model) and lists the data items present in the data store. In one implementation, depending on the configuration of the browser, more or less detail about the data model maybe displayed. On the right side of the user interface is a detailed view 626 supplying more information about marked or selected objects in the tree view. For each data item, certain attribute values are displayed (i.e. meta-data values). The list of attributes to be displayed can be selected through a popup dialog window (not shown), and may be associated with one or more data files. The relative size of the tree view and detailed view sections can be adjusted with a movable separation.

[0175] In addition, the browser may utilize the data model or meta-data associated with the data store contents so that the browser is able to properly interpret data of any type and properly display the data. For example, the browser may utilize the meta-data to determine a structure of the data and display the data according to the determined structure. The data may then be displayed so as to indicate the relationship among the plurality of elements. One embodiment of a hierarchical display that may be used in browsing function 622 is shown in FIG. 11, as described in detail above. It is noted that the hierarchical view may be displayed in response to user input specifying criteria limiting the displayed data. The user input may refer to one or more data files, or hierarchical elements from one or more data files, for example, a group in one file and a channel in another file. Numerous other combinations and examples may be practices in various embodiments.

[0176] The browser also includes a number of popup dialogs used to access and parameterize different functions of the browser such as filtering and searching. The browser can filter the display of data items in its user interface based on the attribute values (i.e., indexed meta-data) of the data items.

[0177] The browser may also include a search function to search the current data store for specific data items that fit certain criteria. In one embodiment, a separate dialog to perform the search may be displayed, as shown in FIGS. 13 and 14. Referring to FIG. 14, the user can specify the portion of the data store to search in, as well as the search criteria, e.g., the attribute values of the data items. As shown in FIG. 14, the search function may involve a text search, wherein the scope of the searched data may be specified according to the TDM hierarchical data model. In one embodiment, the search functions do not require the searched data files to be opened and do not require reading data from files; instead the search is performed on indexed meta-data, which provides the ability for rapid and precise searching throughout the enterprise system. The found items may be displayed either in an additional section of the dialog or in a new section of the main browser window.

[0178] The browser control can be configured using a configuration file to determine the exact display of the data model and data items. This includes the browse path through the data model, as well as attributes to be displayed and any filter settings.

[0179] It is noted that a conditional query may also be issued through a user interface, as shown in FIGS. 13 and 14, or by a programmatic command interface, for selecting portions of data according to conditions or values of attributes. In one embodiment a query may also be processed and results of the query retrieved without requiring a queried data file to be opened, but rather by executing the query on indexed meta-data.

[0180] In FIG. 15, a user interface is illustrated which performs a numerical analysis on selected channels in a browser control, in some embodiments. In FIG. 16, a user interface is illustrated which may display a graphical plot of numerical measurement data, in certain embodiments. The data for the plot may be selected from data channels available for browsing, as described above.

[0181] In FIG. 17, a further user interface panel is illustrated which illustrates how different search criteria may be interactively applied and intermingled with browsing of measurement data in a data store. The functionality the presently described methods provide for measurement data enable similar search capabilities as well-known search engines have provided for general information search on the Internet. In particular, coping with the volume of data generated in today's test environments presents numerous challenges within an enterprise system, including losing important data and spending excessive time analyzing and reporting data. In one example embodiment, a DIAdem DataFinder may provide the ability to locate data faster, and the ability to search for patterns and trends that were not previously possible when data was saved in flat files scattered across the enterprise. By adopting the DIAdem DataFinder, the value of data collected within an enterprise system may be increased and a dramatic impact on measurement data processing activities may be realized, including shortening the product development cycle.

FIG. 19—Exemplary Method for Interactively Setting a Search Value

[0182] FIG. 19 illustrates an exemplary method for interactively setting a search value in a data finder tool, e.g., for the TDM infrastructure 320. Note that the method shown in FIG. 19 may be used in conjunction with any of the systems or devices shown in the above Figures, among other systems. For example, the method may be performed by the TDM infrastructure 320 on a computer system 101 for accessing measurement data within the enterprise system 200. In various embodiments, some of the method elements shown may be performed concurrently, in a different order than shown, or may be omitted. Additional method elements may also be performed as desired. As shown, this method may operate as follows.

[0183] In 1902, first user input specifying a first portion of first search criteria for desired data may be received, e.g., to a graphical user interface (GUI). In some embodiments, the GUI may be used as a searching GUI (e.g., the data finder tool) for the TDM infrastructure 320, e.g., to locate measurement data in the TDM infrastructure 320. Additionally, the GUI may be implemented for users accessing the TDM infrastructure 320 locally and/or for remote users. For example, in one embodiment, the GUI may be used by users over the internet or via a program executing the GUI on a network. However, it should be noted that the GUI may be used locally as well. Furthermore, the user may interact with the TDM infrastructure 320 via a script. For example, the user may simply enter search queries to the TDM infrastructure and/or a search engine used to interact with the TDM infrastructure by using scripts. Additionally, or alternatively, the GUI may interact with the TDM infrastructure 320 for the user via scripting methods. Thus, according to various embodiments, the first portion of the first search criteria may be entered via a variety of methods.

[0184] Turning now to FIG. 20, the first search criteria may include various search variables for retrieving information from the plurality of data files, e.g., stored in the TDM infrastructure 320. In some embodiments, one or more of the search variables may relate to meta-data and/or the index of the data files. For example, the search variables may include a location/level 2002 of the search (e.g., file, group, channel, and/or other levels/locations in the database), a property 2004 (e.g., “file name”), an operator 2006 (e.g., “equals”), and a value 2008 (e.g., a search value, in this case “ex*”), among other variables. Thus, in this example, the level, the property, and the value variables may relate to the meta-data of the data, e.g., the measurement data, stored in the data files.

[0185] The first portion of the first search criteria may include one or more of the level 2002, the property 2004, the operator 2006, and/or the value 2008 (among other variables in the first search criteria). It should be noted that the above search criteria variables are exemplary only, and in fact other values are envisioned. For example, the search locations may further include group and channel (as indicated above, among others). Additionally, other properties may include file name, path, DataPlugin name, creation date, modify date, name, author, description, storage time, title for the root level, name and description for the group level, and/or name, description, minimum, maximum and unit for the channel level, among others. In some embodiments, available operators may include greater than, less than, not equals, equals, number, and/or other operators. Finally, the value may be any value the user wishes to query for, e.g., any text, numbers and/or date/time that the user wishes to search for in the TDM infrastructure 320. Additionally, it should be noted that the variables listed above are exemplary only, and other variables are envisioned. Thus, according to various embodiments, the user may input a first portion of first search criteria into a GUI, e.g., to search for measurement data in a database.

[0186] As shown in the navigator window illustrated in FIG. 20, the user may be able to click on button 2020 which is depicted as a “ . . . ” button (ellipses button) and/or “Search Files” button 2025. In some embodiments, upon clicking the “Search Files” button 2025, a search may be performed and displayed in the results section 2050 (e.g., in this case, “EXAMPLE.TDM”). However, when the user clicks the button 2020, in 1904, information regarding possible values of a second portion of the first search criteria may be retrieved. The possible values may depend on the first portion of the first search criteria.

[0187] It should be noted that 1904 may be performed in response to stimulus other than the user clicking on button 2020; in other words, the specific implementation of the button 2020 is exemplary only. For example, in one embodiment, the retrieval of the information regarding possible values may be performed automatically, e.g., while the user enters or otherwise specifies the first portion of the first search criteria. Additionally, following the embodiments above where the user (and/or the GUI) may interact with the TDM infrastructure 320 via script(s), the GUI and/or the user may retrieve the information regarding the possible values using a scripting command. More specifically, in one embodiment, the script may request the information and receive that information (e.g., the list of possible values) in, for example, an array or matrix. Correspondingly, the GUI/user may use that information to define appropriate search criteria. Alternatively, or additionally, the GUI may receive that information after initiating the script and provide it to the user via a variety of methods (such as those described herein, among others). Thus, according to various embodiments, the user may initiate the retrieval of the information regarding the possible values via a variety of methods.

[0188] The possible values may refer to valid search terms (i.e., values that exist in the data files) that the user may specify to receive valid search results. It should be noted that the possible values may not be limited to terms entered into the value 2008 portion of the search criteria. For example, in one embodiment, where the user entered search information for value 2008, an operator for the operator 2006, and a specific level for searching in the level 2002, the possible values may be retrieved with regard to valid properties. Thus, the possible values may refer to values in any of the variables of the search criteria and is not only limited to the value information in value 2008.

[0189] Simply stated, the possible values may allow the user to determine an appropriate search term. This may allow the user to avoid a time consuming process whereby he must enter values “blindly” and continually search until finding the desired results. Additionally, this may allow the user to determine and specify the appropriate spelling of values in the first search criteria. Note that the possible terms may not be the same as retrieving search results. More specifically, in one embodiment, the possible values may only return the values associated with the first portion of the first search criteria.

[0190] For example, where the user chooses to search in “File”, with “File name” property, and the equals operator, the possible values may simply list the one or more available file names in that location. In some embodiments, this may be performed relatively quickly by searching through the index of the TDM infrastructure (e.g., the meta-data associated with the measurement data stored in the plurality of data files) instead of the files themselves. Correspondingly, the information regarding the possible values may return information stored in the meta-data or index of the TDM infrastructure.

[0191] In contrast, where the user simply searches for results instead of finding possible values, each file matching the query may be displayed which may require retrieving more information than just the possible values. For example, where there are duplicate names (but different files), each of these files may be listed as well as additional information, e.g., the storage location of the files. This full search may require more time/resources to perform than searching the index/meta-data of the TDM infrastructure and returning results from that index/meta-data. Thus, retrieving information regarding the possible values may be a quicker and more user-friendly process than entering a query and performing a full search.

[0192] In 1906, the information regarding the possible values of the second portion of the first search criteria may be displayed. The information may be usable to select the second portion of the first search criteria. Following the example illustrated in FIG. 20, FIG. 21 provides an exemplary screen image where the user has entered a first portion of the first search criteria (e.g., searching in “file”, with property name “file name”, and with operator “=”) and information regarding the possible values of the second portion of the first search criteria is displayed. As shown, in window 2102, 16 possible file names are displayed (e.g., “COUP3A.WFT, . . . , Data1.tdm, . . . , Kopie von COUP3A.WFT, etc.).

[0193] As also shown, in window 2102, the user may be able to search in the list of possible values. Additionally, or alternatively, the user may be able to select one or more of the possible search values and they may be automatically entered into the first search criteria for the user. For example, the user may be able to click “Data1.tdm” and that search value may be entered as the value for the first search criteria. Thus, according to one embodiment the possible values for the second portion of the first search criteria (in this case for the value 2008) may be retrieved and displayed, e.g., in response to user input.

[0194] FIG. 22 illustrates another exemplary search value preview (in the window 2102). In this specific example, the user has specified a complete search criteria where the search is performed in files, the property is the creation date, the operator is equals, and the value is Aug. 11, 2006. As shown in this Figure (in the window 2102), the possible values for the value 2008 is displayed as a date range from the minimum date (Jul. 21, 2006) to the maximum date (Aug. 10, 2006). Thus, in this case, the user can easily find out that the currently entered search term would not yield results without having to perform a full search. Instead, the minimum and the maximum dates are listed and the user can easily determine that the currently entered value is outside of that range. Similar to above, the user may be able to specify the value of the creation date by selecting the minimum or the maximum date shown in the window 2102. It should be noted that displaying the minimum and maximum for a range may apply to other data types other than date; for example, the minimum and maximum may be displayed for integers, floats, time attributes, and/or other ordered data. Additionally, displaying the minimum and maximum for this ordered data is exemplary only, and in fact, in some embodiments, the possible values may be displayed in a list format similar to the example above regarding file names.

[0195] Thus, according to various embodiments, a list of possible values may be retrieved and displayed in response to user input specifying a first portion of first search criteria.

FIG. 23—Exemplary Method for Adaptively Setting a Search Value

[0196] FIG. 23 illustrates an exemplary method for adaptively setting a search value in the data finder tool. Note that the method shown in FIG. 23 may be used in conjunction with any of the systems or devices shown in the above Figures, among other systems. For example, the method may be performed by (or with) the TDM infrastructure 320, e.g., on the computer system 101, for accessing measurement data within the enterprise system 200. In various embodiments, some of the method elements shown may be performed concurrently, in a different order than shown, or may be omitted. Additional method elements may also be performed as desired. As shown, this method may operate as follows.

[0197] In 2302, first user input may be received specifying first search criteria for desired data. In various embodiments, the user input may be received via a graphical user interface (GUI) or other methods such as scripts. Similar to descriptions above, the first search criteria may involve search locations/levels, properties, operators, and values, among other search variables. Additionally, the input may be received via a variety of methods/systems. For example, in one embodiment, the user input may be received to a GUI similar to the GUI shown in the above Figures. Alternatively, or additionally, the GUI and/or the user may interact with the TDM infrastructure using one or more scripts or other scripting methods, e.g., similar to the scripts described above, among others. Thus, user input may be received which specifies a first search criteria, e.g., for searching for measurement data among a plurality of data files in an enterprise system, e.g., in the TDM infrastructure 320 described above.

[0198] In 2304, second user input may be received specifying a first portion of second search criteria for the desired data. Similar to above, the input may be received via the GUI or various scripts (among other methods). Also similar to above, the second search criteria may involve the locations, properties, operators, and/or values already described (among others) and may be entered according to various methods. Additionally, the first portion of the second search criteria may include any one or more of the search variables. Thus, a first portion of second search criteria may be received.

[0199] In 2306, information may be retrieved regarding possible values of a second portion of the second search criteria. Similar to above, the information retrieval may be performed in response to user input or automatically as desired. Additionally, the information may return possible values based on the first portion of the second search criteria, e.g., using the index or meta-data of the measurement data instead of the measurement files themselves. In some embodiments, the information may retrieved in response to the first portion of the second search criteria and the first search criteria thereby adapting to previously entered search criteria. In some embodiments, further search criteria may be entered or may previously have been entered, e.g., using the GUI or scripting methods (among others). In such embodiments, the search value preview (the information being retrieved) may be based on all of the previously entered search criteria (e.g., displayed in the GUI) as well as a portion of the most recently entered search criteria (or the fully specified most recently entered search criteria as desired). Additionally, or alternatively, in one embodiment, the information may be retrieved in response to a scripting call and may be stored in, for example, an array or matrix of values which may be provided to the GUI/user. Thus, according to some embodiments, the information retrieved regarding possible values may take into account all of the criteria, e.g., entered into the GUI or via various scripts.

[0200] In 2308, the information regarding the possible values of the second portion of the second search criteria may be displayed, e.g., in the GUI. Similar to above, the information regarding the possible values of the second portion (or the second portion of the most recently entered search criteria) may be displayed, e.g., in a window of the GUI. FIG. 24 illustrates an exemplary screen shot where the user has specified a first criteria (at the file level, with “creation date” property, # operator, and value of “last 7 days”) as well as a second search criteria (also at the file level, with “DataPlugin name”, =operator, and value of “TDM”) and finally a portion of a third search criteria (at the file level, file name property, =operator, and no value currently entered). As shown in the window 2102, a list of possible values matching all of the entered criteria is displayed. In this case the 6 files were all created in the last 7 days and were of plugin type “TDM”. Similar to above, the user may be able to simply choose at least one possible value and it may be entered automatically for the user. FIG. 25 illustrates a similar search, except in this case, the user has specified that the file name include the string “test”; correspondingly, the three available values test'file1.tdm, test'file2.tdm, and test'file3.tdm are displayed in the window 2102.

[0201] It should be noted that in some embodiments, the information may be cached for each entered search criteria and then search the cached information for subsequent entered criteria, thereby allowing for a highly-efficient process for returning information regarding the possible values. However, it should be noted that in alternate embodiments, the information regarding the possible values may be performed each time a new search criteria is entered.

[0202] Thus, according to various embodiments, the GUI (e.g., the datafinder) described above for searching the TDM infrastructure may adaptively display valid values for the user before a complete search is performed. Note, however, that the specific illustrated GUI and methods described above are exemplary only and that other methods (e.g., scripting methods or others), GUIs, graphical layouts, etc., are envisioned.

FIG. 26—Exemplary Method for Remotely Accessing Data

[0203] FIG. 26 illustrates an exemplary method for remotely accessing data, e.g., in the TDM infrastructure 320. Note that the method shown in FIG. 26 may be used in conjunction with any of the systems or devices shown in the above Figures, among other systems. For example, the method may be performed with respect to the TDM infrastructure 320, e.g., on the computer system 101 for accessing measurement data within the enterprise system 200. In various embodiments, some of the method elements shown may be performed concurrently, in a different order than shown, or may be omitted. Additional method elements may also be performed as desired. As shown, this method may operate as follows.

[0204] In 2602, a query for desired measurement data may be received over a network from a remote client. Similar to descriptions above regarding the computer system 101, the remote client may be any of various appropriate remote clients, e.g., PDAs, desktop machines, laptop machines, and/or other computing systems. Additionally, the desired measurement data may be included in the measurement data stored in the plurality of files of the enterprise system (e.g., the TDM infrastructure 320). Additionally, as noted above, meta-data may be associated with the measurement data which describes characteristics of the measurement data. Similar to descriptions above, the measurement data and/or the meta data may have previously been stored in the plurality of data files, e.g., in the TDM infrastructure 320.

[0205] In some embodiments, the remote client may use the GUI described above to query information from the TDM infrastructure 320, e.g., using the data finder described above. For example, the remote client may use the GUI to interactively and/or adaptively search for measurement data. More specifically, in one embodiment, the remote user may be able to use the GUI to view possible values for the query using the preview button 220 (described above in more detail). Additionally, or alternatively, the remote client may transmit the query over the Internet or another wide area network (WAN) using other software, e.g., an internet browser.

[0206] However, where the client is connected to the TDM infrastructure 320 via other means, it may be necessary to communicate connection information to the remote client, e.g., before receiving the query. In such cases, the administrator of one or more servers associated with receiving queries, and/or the TDM infrastructure 320 may be operable to communicate connection parameters and/or server name(s) for the server(s)/TDM infrastructure 320 to the remote client. In some embodiments, these connection parameters and server name may be packaged in a “datafinder” definition. The definition may be transmitted as a single file or may span a plurality of files as desired.

[0207] Similar to descriptions above, in 2604, the index of the plurality of data files may be searched according to the query received from the remote client. As described above, the index may be organized according to the meta-data of the measurement data stored in the plurality of data files in the TDM infrastructure 320.

[0208] Upon locating the desired measurement data based on the query received from the remote client, in 2606, the desired measurement data may be provided to the remote client over the network. For example, the measurement data may be provided to the remote client via a WAN or the Internet. Alternatively, the measurement data may be provided over a local network. Note that the above described networks are exemplary only and any of a variety of appropriate networks are envisioned.

[0209] In 2608, one or more plug-in may be provided to the remote client over the network. In some embodiments, the one or more plug-ins may be usable by the remote client to view the desired measurement data. In some embodiments, the plug-in(s) may be provided to the remote client only when the remote client needs the one or more plug-ins. For example, in some embodiments, the remote client may send a request for the plug-in(s) after determining whether it is able to open the desired measurement data. Additionally, or alternatively, the server/TDM infrastructure 320 may ask a user, e.g., operating the remote client, whether plug-ins are necessary. Correspondingly, in some embodiments, if it is determined that the remote client requires the plug-ins, the plug-ins may be provided to the remote client. Thus, in some embodiments, a user may connect to a server and/or the TDM infrastructure to search and receive desired measurement data. Where the remote client is not able to view the desired measurement data, one or more plug-ins may be provided to the remote client to address the issue. For example, if a scientist connects to a DataFinder server containing earthquake data, that data may be available in many different file formats, e.g., in SMCSM, a common earthquake data format. When that scientist wants to load SMCSM data, he may need the same DataPlugin that the DataFinder used to index it. Since the DataFinder has the SMCSM DataPlugin it may provide that plug-in to the remote client.

[0210] In some embodiments, the one or more plug-ins may be provided to the remote client based on the desired measurement data. For example, following the example above where the user searched and found earthquake data in SMCSM, the method may include providing an SMCSM plug-in to the remote client so that the user can view/manipulate the desired measurement data. Thus, in some embodiments, the one or more plug-ins may be provided to the remote client may be specific to the desired measurement data. Alternatively, the one or more plug-ins may be provided to the client at a different time. For example, the server, administrator, and/or TDM infrastructure 320 may provide the connection data described above (including connection parameters and/or a server name) as well as the one or more plug-ins. In one embodiment, the one or more plug-ins provided to the remote client may include plug-ins stored on the server/TDM infrastructure 320. More specifically, the server/TDM infrastructure 320 may provide to the client all (or a subset thereof) of the plug-ins stored on the server/infrastructure so that the client may view any of the data stored on that server/in the TDM infrastructure 320.

[0211] Additionally, or alternatively, the method may also include synchronizing plug-ins between the server/TDM infrastructure and the remote client. Similar to above, in various embodiments, this synchronization may be performed during initial connection or after transmitting the desired measurement data to the remote client (or any other time during the connection) as desired. Following this embodiment, the remote client may be operable to display and/or manipulate any of the measurement data stored in the TDM infrastructure without having to worry about installed components. In other words, the synchronization may allow the user at the remote client to seamlessly view any of the queried measurement data found using the GUI/data finder. In some embodiments, the synchronization may occur transparently (i.e., where the user is not aware of the synchronization) thereby allowing the user to view the desired data without any compatibility issues.

[0212] Thus, according to various embodiments, a user may remotely search and retrieve desired measurement data in the TDM infrastructure. Additionally, a plug-in may be provided that allows the user to view/manipulate the desired measurement data.

Custom Properties

[0213] In some embodiments, a user or administrator of the TDM infrastructure may be able to add one or more custom properties to the meta-data associated with the measurement data stored in the plurality of data files in the TDM infrastructure. In some embodiments, meta-data may be stored in tables (e.g., in a relational SQL database) that each correspond to a level of data. For example, there may be a root level table (e.g., a file level), a group level table (e.g., for channel groups), and a channel level table (e.g., for specific channel information). Each table may have a set of base attributes; for example, for the root level, the base attributes may include a name, description, title, author, datetime, and/or other attributes (e.g., register strings, among others). In some embodiments, there may be tables associated with the base attributes (base tables), and other tables used for custom properties (custom property tables). Thus, a table may store data associated with each level and have core attributes for entries in each table. Note that the above described levels/tables are exemplary only and that other levels and/or tables are envisioned.

[0214] To specify custom properties, the user or administrator may add the custom properties to the TDM infrastructure at a specific level (e.g., root, group, or channel levels, among others). In some embodiments, custom properties may be automatically added, e.g., when the user adds a measurement file to the TDM infrastructure which includes properties other than those stored in the base tables (i.e., custom properties). In such situations, the user and/or the TDM infrastructure (or server associated therewith) may add the new custom properties to a custom property table. In some embodiments, the new custom properties for the file may be added to a custom property table at the appropriate level. For example, if the custom properties are at the root level, then they may be added to the root custom property table. Additionally, note that if there isn't a custom property table at the appropriate level, the method (e.g., the user and/or server) may create the appropriate custom property table. Thus, in one embodiment, the custom properties may be stored in an appropriate custom property table (e.g., according to level) on a per file basis. This may allow the system to conserve storage space since the custom properties are only created in the tables when the file contains data for those custom properties. Thus, base tables and custom property tables may be indexed for future searching according to various embodiments.

[0215] While this custom property table approach may conserve storage space, it may lead to undesirable search times. More specifically, when a query is performed on a custom property, a search may have to examine each row in the custom property table which is often a lengthy process. This can be especially burdensome when the search requires a search for strings (e.g., file names, or other character data) in the custom property tables. Said another way, since one base table row can have zero-to-many custom properties, there may be zero-to-many rows in the custom property table. This may complicate the queries (e.g., SQL queries) for search operations and therefore may slow down searches that contain conditions on custom properties.

[0216] To overcome this searching problem, users may determine which custom properties should become “optimized”. This optimization may allow for faster searching of the custom properties that have been optimized. In one embodiment, in order to optimize the searching of these properties, a new optimized custom property table may be generated/added to (as appropriate). Similar to above, the optimized custom property tables may be generated according to level (e.g., one for root, one for groups, and one for channels, as appropriate). The optimized custom property tables have entries for each measurement file in the TDM infrastructure. In other words, the new optimized custom property tables essentially act as extensions to the base attributes. For example, when a new file is inserted into the TDM infrastructure, an entry for the optimized custom property tables may be entered if the new file has at least one of those customized properties. Thus, when a search is performed which needs to search one of the optimized custom property tables a one-to-one join of the base table and the optimized custom table may be performed, and the search on the optimized custom property may execute as quickly as the base attributes. In this embodiment, the search on an optimized custom property may be magnitudes faster than a search on an unoptimized custom property (where a many-to-one join may be performed).

[0217] FIG. 27 is a flowchart which illustrates the exemplary method described above. As shown, the data finder index may include a root table (other levels not shown for clarity) and a root custom property table. As shown, the root table may have an entry of name “crash” and id “42”. The custom properties table may store custom properties of the crash file; in this case the custom properties include TestSupervisor (datatype string, val_str ralf) and TestDurationSec (datatype int, val_int 2). At some point in time, the user may realize that he often searches for TestSupervisor. Following the embodiments above, search performance may be improved using optimized custom properties. Correspondingly, the user may choose to optimize the custom property “TestSupervisor”. After optimization, the root table may now include the column “TestSupervisor” as shown. As indicated above, this may be performed by merging the root optimized custom property table with the base root table. However, in one embodiment, the method (e.g., the server/TDM infrastructure) may add the column directly to the root base table. Note that the root custom properties table may still contain the original data. Thus, in some embodiments, the optimized custom properties may be duplicated in both the base table and the custom property table. Note that when the property “TestSupervisor” is queried, the server/data finder may search in the base table rather than the custom properties table to conserve time.

[0218] Turning now to FIG. 28, the user may later reconfigure the optimized custom properties. For example, the user may decide that the TestSupervisor custom property should not be optimized and the TestDurationInSec should be. In this case, the method (e.g., the server) may remove the TestSupervisor custom property from the base table and add the TestDurationInSec custom property to the base table (e.g., using the method described above). Now, when searches are performed for the TestSupervisor, the method/server may search in the custom properties table (which still contains the data because it was not deleted during optimization). Conversely, when searches are performed for the TestDurationInSec, the method/server may search in the root table (e.g., after being merged with the optimized custom property table). Thus, according to various embodiments the user may optimize searching for various custom properties in the TDM Infrastructure without disrupting operation.

[0219] FIG. 29 illustrates an exemplary GUI whereby the user/administrator may choose which custom properties should be optimized and/or unoptimized. As shown, AnUnimportantCustomProperty may be optimized, TestDurationInSec may be optimized, and TestSupervisor may not be optimized. In this example, the user may be able to simply click on the optimized portion (e.g., for AnUnimportantCustomProperty) and choose “Not Optimized”. Upon accepting the change (e.g., by clicking the “OK” button), the database (e.g., the database index) may update according to the methods described above. Note that the GUI shown in FIG. 29 is exemplary only and that other methods for changing between optimized custom properties and unoptimized custom properties are envisioned. Thus, according to various embodiments, optimizations (and/or removals thereof) may be performed on the fly without modifying files in the TDM infrastructure.

[0220] Additionally, or alternatively, the method (e.g., the TDM infrastructure/server or programs executing thereon) may also automatically determine which custom properties should be optimized/unoptimized. For example, in one embodiment, the method may examine the index for the measurement data files and determine which custom properties are most prevalent in the measurement data. In some embodiments, the method may determine an appropriate threshold (or the threshold may be specified by the user) which may be used to determine whether a custom property should be optimized and/or whether an already optimized custom property should be converted back to a normal custom property. In one specific example, the threshold may be 50%; more specifically, if a custom property is specified for more than half of the measurement data (e.g., for a specific type of measurement data), the method may optimize that custom property. In contrast, if an optimized custom property falls below the threshold, then the optimized custom property may be converted to a normal custom property. Note that in some embodiments, two different thresholds may be used, e.g., a first threshold for determining whether a custom property should be optimized, and a second threshold for determining whether an optimized property should be converted to a normal custom property.

[0221] In some embodiments, this determination may be initiated by a user or performed automatically as desired. For example, the user may be able to click on a button in a GUI for the TDM infrastructure that performs this determination. In some embodiments, the user may then be presented with a list of suggested changes and asked for confirmation; however, in other embodiments, the optimizations may be performed autoatmically without confirmation from the user. Alternatively, or additionally, the method may perform this determination and optimization/unoptimization on a scheduled basis, e.g., every month, week, or day (among other time periods). The scheduled basis may be determined automatically or specified by the user as desired. Thus, according to various embodiments, the method may determine whether various ones of the custom properties should be optimized/unoptimized and perform those optimization/unoptimizations.

[0222] Performing these optimizations (and “unoptimizations”) via the methods described above may allow the administrator/user to quickly and efficiently change the way searches are performed in the TDM infrastructure. These methods may allow for better efficiency since the actual files may not be changed, and instead, columns may be added or removed to the base tables very quickly. Thus, these methods avoid the costly process where administrators would have to reindex an entire database to make a simple change to the properties stored in the database. Correspondingly, the administrator may save time and effort both in changing the structure in the TDM infrastructure and in performing searches for the optimized custom properties.

FIG. 30—Exemplary Method for Optimizing Custom Properties

[0223] FIG. 30 is a flowchart diagram illustrating an exemplary method for optimizing custom properties. Note that the method shown in FIG. 30 may be used in conjunction with any of the systems or devices shown in the above Figures, among other systems. For example, the method may be performed with respect to the TDM infrastructure 320, e.g., on the computer system 101 for accessing measurement data within the enterprise system 200. In various embodiments, some of the method elements shown may be performed concurrently, in a different order than shown, or may be omitted. Additional method elements may also be performed as desired. As shown, this method may operate as follows.

[0224] In 3002, an index may be stored. The index may store meta-data associated with measurement data and include a plurality of tables. As indicated above, the tables may be partitioned/created according to the level of the data, e.g., root, group, and/or channel levels (among others). Additionally, the tables may include base tables which store base properties of the measurement data. More specifically, in one embodiment, the meta-data may be stored in a plurality of tables, each associated with particular levels of data. Additionally, the plurality of tables may make up the index. As also described above, the index may offer an efficient means for searching for desired data in the measurement data. Thus, an index may be stored, e.g., in the TDM infrastructure 320 (or a server thereof) and may be usable for searching.

[0225] In 3004, a value of a custom property may be stored in a custom property table which may be comprised in the plurality of tables. As indicated above, the custom property table may be created with respect to a given level of data. For example, if the custom property is at a root level, the new custom property may be stored in the custom property table for the root level, e.g., a root custom property table. In some embodiments, the custom property may be stored in the custom property in response to user input or after analyzing the incoming measurement data (among inputs/determinations). For example, in one embodiment, new measurement data may be automatically analyzed (i.e., without any direct user input indicating the analysis) for custom properties. Accordingly, where there is a property that is not stored in the base property table(s), a new entry in the custom property table may be entered with a reference to the specific ID of the measurement data. Thus, a custom property may be stored in a custom property table.

[0226] In 3006, a new column may be created for at least one base table. In some embodiments, this may be performed in response to determining whether the custom property should be optimized, e.g., automatically, or in response to user input (among other determinations) following the descriptions above. For example, the user may indicated that the custom property should be optimized for searching; additionally, or alternatively, the method may automatically analyze the index to determine if the custom property should be indexed. In some embodiments, this automatic analysis may be initiated by the user or scheduled, among other methods, as desired. As indicated above, creating the new column may be performed by creating a new table (e.g., a new optimized custom table, e.g., for the specific data level of the custom property) and merging that table with the base property table (e.g., at that level). Accordingly, after the value for the custom property is merged and/or created in the base table, searches for the custom property may behave as if it were a base property. In this case, the custom property may be searchable without requiring searching of the custom property table.

[0227] Additionally, as described above, this process of entering custom properties and optimizing the property may be performed without reindexing the meta data. In other words, the database (e.g., the database index) storing all of the meta-data may not be reindexed/recreated. As indicated above, this process may be performed on the fly.

[0228] In one embodiment, as also described above, the method may include changing the optimized custom property back to a “normal” custom property, e.g., by deleting the new column from the base table. Subsequently, the custom property may be searched using the custom property table instead of the base table. As described above, the custom property may be duplicated in both the optimized custom property table and the custom property table when optimized and may only be stored in the custom property table when it is not optimized. Additionally, similar to above, the meta-data may not have to be reindexed when the custom property is converted to a normal custom property (i.e., “unoptimized”).

[0229] Thus, according to various embodiments, custom properties may be optimized such that searches can be more quickly performed.

[0230] Various embodiments may further include receiving or storing instructions and/or data implemented in accordance with the foregoing description upon a carrier medium. Suitable carrier media may include storage media or memory media such as magnetic or optical media, e.g., disk or CD-ROM, as well as transmission media or signals such as electrical, electromagnetic, or digital signals, conveyed via a communication medium such as a network and/or a wireless link.

[0231] While the present invention has been described with reference to particular embodiments, it will be understood that the embodiments are illustrated and that the invention scope is not so limited. Any variations, modifications, additions and improvements to the embodiments described are possible. These variations, modifications, additions and improvements may fall within the scope of the invention as detailed within the following claims.