CA2542109A1 - Set-oriented real-time data processing based on transaction boundaries - Google Patents

Set-oriented real-time data processing based on transaction boundaries Download PDF

Info

Publication number
CA2542109A1
CA2542109A1 CA002542109A CA2542109A CA2542109A1 CA 2542109 A1 CA2542109 A1 CA 2542109A1 CA 002542109 A CA002542109 A CA 002542109A CA 2542109 A CA2542109 A CA 2542109A CA 2542109 A1 CA2542109 A1 CA 2542109A1
Authority
CA
Canada
Prior art keywords
transaction boundaries
data records
setting
transaction
transformations
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CA002542109A
Other languages
French (fr)
Other versions
CA2542109C (en
Inventor
Gautum H. Mudunuri
Raymond G. To
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Informatica LLC
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of CA2542109A1 publication Critical patent/CA2542109A1/en
Application granted granted Critical
Publication of CA2542109C publication Critical patent/CA2542109C/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2455—Query execution
    • G06F16/24568—Data stream processing; Continuous queries
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/242—Query formulation
    • G06F16/2428—Query predicate definition using graphical user interfaces, including menus and forms
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2453—Query optimisation
    • G06F16/24534—Query rewriting; Transformation
    • G06F16/24547—Optimisations to support specific applications; Extensibility of optimisers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28—Databases characterised by their database models, e.g. relational or object models
    • G06F16/284—Relational databases
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00—Data processing: database and file management or data structures
    • Y10S707/99941—Database schema or data structure
    • Y10S707/99942—Manipulating data structure, e.g. compression, compaction, compilation
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00—Data processing: database and file management or data structures
    • Y10S707/99941—Database schema or data structure
    • Y10S707/99943—Generating database or data structure, e.g. via user interface

Abstract

A method is provided for real-time data processing based on data sets or data sets defined by applicable rules or user-defined logic. Also provided is a real-time data processing system that implements such method. Transaction boundaries are set and propagated through cascades of multiple data transformations on multitudes of data records or rows. The method may be implemented in conjunction with a relational database management system (DBMS), object DBMS, or any other DBMS. The method and system for real-time data processing may be advantageously applied in Extract, Transform, and Loan (ETL), Enterprise Application Integration (EAI), and Enterprise Information Integration (EII).

Claims (54)

1. A method for processing a plurality of data records, comprising:
setting transaction boundaries among said plurality of data records thereby dividing the plurality of data records into one or more data sets;
processing each of the data set thereby producing a multiplicity of results from the one or more transaction sets; and completing the processing of the plurality of data records by synchronizing the transaction boundaries and combining said multiplicity of results.
2. The method of claim 1, wherein the setting of transaction boundaries is performed based on the row count of the data records.
3. The method of claim 1, wherein the setting of transaction boundaries is performed based on the time stamp of the data records.
4. The method of claim 1, wherein the setting of transaction boundaries is performed based on the result of a previous data transformation.
5. The method of claim 1, wherein the setting of transaction boundaries is performed based on a user-defined logic, wherein the user-defined logic is one or more rules defined by a user.
6. The method of claim 5, wherein the user-defined logic is on a real-time basis.
7. The method of claim 5, wherein the rules comprise one or more tables in a database.
8. The method of claim 5, wherein the rules comprise one or more statements defining relationships and actions in a suitable programming language.
9. The method of claim 8, wherein the suitable programming language is one of Generation III Languages (3GL), Generation IV Languages (4GL), and Generation V (SGL) Languages.
10. The method of claim 8, wherein the suitable programming language is an expert system tool.
11. The method of claim 1, wherein said processing comprises at least one of insert, update, delete, aggregation, rank, sort, sequence, and join.
12. A method for performing a series of transformations on a plurality of data records, wherein said series of transformations initiate at a source and conclude at a target, said method comprises:
setting transaction boundaries among said plurality of data records at said source thereby dividing the plurality of data records into one or more data sets;
propagating the transaction boundaries through the series of transformations from the source to the target;
performing said series of transformations based on the one or more data sets thereby producing a multiplicity of results from said series of set-based transformations; and completing the series of transformations by synchronizing the transaction boundaries and combining said multiplicity of results.
13. The method of claim 12, wherein the setting of transaction boundaries is performed based on the row count of the data records.
14. The method of claim 12, wherein the setting of transaction boundaries is performed based on the time stamp of the data records.
15. The method of claim 12, wherein the setting of transaction boundaries is performed based on the result of a previous data transformation.
16. The method of claim 12, wherein the setting of transaction boundaries is performed based on a user-defined logic, wherein the user-defined logic is one or more rules defined by a user.
17. The method of claim 16, wherein the user-defined logic is on a real-time basis.
18. The method of claim 16, wherein the rules comprise one or more tables in a database.
19. The method of claim 16, wherein the rules comprise one or more statements defining relationships and actions in a suitable programming language.
20. The method of claim 19, wherein the suitable programming language is one of Generation III Languages (3GL), Generation IV Languages (4GL), and Generation V Languages (SGL).
21. The method of claim 19, wherein the suitable programming language is an expert system tool.
22. The method of claim 12, wherein the propagating comprises setting and maintaining one or more transaction queues capable of defining the boundaries of the data sets.
23. The method of claim 22, wherein the transaction queues comprise one or more tables in a database.
24. The method of claim 22, wherein said transaction queues are maintained in a computer memory.
25. The method of claim 12, wherein said series of transformations comprise at least one of insert, update, delete, aggregation, rank, sort, sequence; and join.
26. A system for processing a plurality of data records, comprising:
means for setting transaction boundaries among said plurality of data records thereby dividing the plurality of data records into one or more data sets;
means for processing each of said data set thereby producing a multiplicity of results from the one or more data sets; and means for synchronizing the transaction boundaries and combining said multiplicity of results thereby completing said processing.
27. The system of claim 26, wherein the means for setting transaction boundaries defines the transaction boundaries based on the row count of the data records.
28. The system of claim 26, wherein the means for setting transaction boundaries defines the transaction boundaries based on the time stamp of the data records.
29. The system of claim 26, wherein the means for setting transaction boundaries defines the transaction boundaries based on the result of a previous data transformation.
30. The system of claim 26, the means for setting transaction boundaries comprises defines the transaction boundaries based on a user-defined logic, wherein~

the user-defined logic is one or more rules defined by a user.
31. The system of claim 30, wherein the user-defined logic is on a real-time basis.
32. The system of claim 30, wherein the rules comprise one or more tables in a database.
33. The system of claim 30, wherein the rules comprise one or more, statements defining relationships and actions in a suitable programming language.
34. The system of claim 33, wherein the suitable programming language is one of Generation III Languages (3GL), Generation IV Languages (4GL), and Generation V Languages (SGL).
35. The system of claim 33, wherein the suitable programming language is an expert system tool.
36. The system of claim 26, wherein said processing comprises at least one of insert, update, delete, aggregation, rank, sort, sequence, and join.
37. A system for performing a series of transformations on a plurality of data records, wherein said series of transformations initiate at a source and conclude at a target, said system comprises:
means for setting transaction boundaries among said plurality of data records at the source thereby dividing the plurality of data records into one or more data sets;
means for propagating the transaction boundaries through the series of transformations from the source to the target;
means for performing said series of transformations based on the one or more data sets thereby producing a multiplicity of results from said series of set-based transformations; and means for synchronizing the transaction boundaries and combining the multiplicity of results thereby completing the series of transformations.
38. The system of claim 37, wherein the means for setting transaction boundaries defines the transaction boundaries based on the row count of the data records.
39. The system of claim 37, wherein the means for setting transaction boundaries defines the transaction boundaries based on the time stamp of the data records.
40. The system of claim 37, wherein the means for setting transaction boundaries defines the transaction boundaries based on the result of a previous data transformation.
41. The system of claim 38, the means for setting transaction boundaries defines the transaction boundaries based on a user-defined logic, wherein the user-defined logic is one or more rules defined by a user.
42. The system of claim 41, wherein the user-defined logic is on a real-time basis.
43. The system of claim 41, wherein the rules comprise one or more tables in a database.
44. The system of claim 41, wherein the rules comprise one or more statements defining relationships and actions in a suitable programming language.
45. The system of claim 44, wherein the suitable programming language is one of Generation III Languages (3GL), Generation IV Languages (4GL), and Generation V Languages (5GL).
46. The system of claim 44, wherein the suitable programming language is an expert system tool.
47. The system of claim 37, wherein the means for propagating the transaction boundaries comprises setting and maintaining one or more transaction queues capable of defining the boundaries of the data sets.
48. The system of claim 47, wherein said transaction queues comprise one or more tables in a database.
49. The system of claim 47, wherein said transaction queues are maintained in a computer memory.
50. The system of claim 37, wherein said series of transformations comprise at least one of insert, update, delete, aggregation, rank, sort, sequence, and join.
51. A computer program product implementing the system of claim 26.
52. A computer program product implementing the system of claim 37.
53. A computer readable medium having recorded thereon program instructions which when processed by a computer are capable of executing a method for processing a plurality of data records, said method comprising:
setting transaction boundaries among said plurality of data records thereby dividing the plurality of data records into one or more data sets;
processing each of said data set thereby producing a multiplicity of results from the one or more data sets; and completing the processing of said plurality by synchronizing the transaction boundaries and combining said multiplicity of results.
54. A computer readable medium having recorded thereon program instructions which when processed by a computer are capable of executing a method for performing a series of transformations on a plurality of data records, said method comprising:
setting transaction boundaries among said plurality of data records thereby dividing the plurality of data records into one or more data sets;
propagating the transaction boundaries through said series of transformations;
performing said series of transformations based on the one or more data sets thereby producing a multiplicity of results from said series of set-based transformations; and completing the series of transformations by synchronizing the transaction boundaries and combining said multiplicity of results.
CA2542109A 2003-12-03 2004-11-12 Set-oriented real-time data processing based on transaction boundaries Active CA2542109C (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US10/727,700 2003-12-03
US10/727,700 US7254590B2 (en) 2003-12-03 2003-12-03 Set-oriented real-time data processing based on transaction boundaries
PCT/US2004/037698 WO2005060461A2 (en) 2003-12-03 2004-11-12 Set-oriented real-time data processing based on transaction boundaries

Publications (2)

Publication Number Publication Date
CA2542109A1 true CA2542109A1 (en) 2005-07-07
CA2542109C CA2542109C (en) 2012-03-20

Family

ID=34633532

Family Applications (1)

Application Number Title Priority Date Filing Date
CA2542109A Active CA2542109C (en) 2003-12-03 2004-11-12 Set-oriented real-time data processing based on transaction boundaries

Country Status (4)

Country Link
US (1) US7254590B2 (en)
EP (1) EP1690158A4 (en)
CA (1) CA2542109C (en)
WO (1) WO2005060461A2 (en)

Families Citing this family (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8311974B2 (en) * 2004-02-20 2012-11-13 Oracle International Corporation Modularized extraction, transformation, and loading for a database
US20050234963A1 (en) * 2004-04-19 2005-10-20 International Business Machines Corporation Method and system for transactional log processing
US8554806B2 (en) 2004-05-14 2013-10-08 Oracle International Corporation Cross platform transportable tablespaces
EP1736876A1 (en) * 2005-06-01 2006-12-27 Sap Ag Parallel generation of bundles of data objects
US7587388B2 (en) * 2005-07-28 2009-09-08 Microsoft Corporation Separating uploads into aggregate and raw data storage
US7844942B2 (en) * 2006-06-12 2010-11-30 International Business Machines Corporation System and method for model driven transformation filtering
US7774189B2 (en) * 2006-12-01 2010-08-10 International Business Machines Corporation System and method for simulating data flow using dataflow computing system
US7747563B2 (en) * 2006-12-11 2010-06-29 Breakaway Technologies, Inc. System and method of data movement between a data source and a destination
US20080201290A1 (en) * 2007-02-16 2008-08-21 International Business Machines Corporation Computer-implemented methods, systems, and computer program products for enhanced batch mode processing of a relational database
US8005848B2 (en) * 2007-06-28 2011-08-23 Microsoft Corporation Streamlined declarative parsing
US8037096B2 (en) * 2007-06-29 2011-10-11 Microsoft Corporation Memory efficient data processing
US8122040B2 (en) * 2007-08-29 2012-02-21 Richard Banister Method of integrating remote databases by automated client scoping of update requests over a communications network
US7941460B2 (en) * 2007-09-05 2011-05-10 International Business Machines Corporation Compilation model for processing hierarchical data in stream systems
US7860863B2 (en) * 2007-09-05 2010-12-28 International Business Machines Corporation Optimization model for processing hierarchical data in stream systems
US8161380B2 (en) * 2008-06-26 2012-04-17 International Business Machines Corporation Pipeline optimization based on polymorphic schema knowledge
US8744994B2 (en) * 2008-12-23 2014-06-03 International Business Machines Corporation Data filtering and optimization for ETL (extract, transform, load) processes
US8626790B2 (en) * 2010-04-23 2014-01-07 Hartford Fire Insurance Company System and method for processing and analyzing dimension data
US9037407B2 (en) 2010-07-12 2015-05-19 Palantir Technologies Inc. Method and system for determining position of an inertial computing device in a distributed network
US9092482B2 (en) 2013-03-14 2015-07-28 Palantir Technologies, Inc. Fair scheduling for mixed-query loads
EP2541408B1 (en) * 2011-06-28 2020-10-07 Amadeus S.A.S. Method and system for processing data for database modification
US8504542B2 (en) * 2011-09-02 2013-08-06 Palantir Technologies, Inc. Multi-row transactions
US8583626B2 (en) 2012-03-08 2013-11-12 International Business Machines Corporation Method to detect reference data tables in ETL processes
US8954376B2 (en) * 2012-03-08 2015-02-10 International Business Machines Corporation Detecting transcoding tables in extract-transform-load processes
CN102663021B (en) * 2012-03-21 2014-12-03 浙江盘石信息技术有限公司 Recognition processing method of data
US20140108189A1 (en) * 2012-10-11 2014-04-17 Rolf Schumann Real-Time Cross-Selling Proposal Calculation
US9123086B1 (en) 2013-01-31 2015-09-01 Palantir Technologies, Inc. Automatically generating event objects from images
US10037314B2 (en) 2013-03-14 2018-07-31 Palantir Technologies, Inc. Mobile reports
US8868537B1 (en) 2013-11-11 2014-10-21 Palantir Technologies, Inc. Simple web search
US9503844B1 (en) 2013-11-22 2016-11-22 Palantir Technologies Inc. System and method for collocation detection
US10579647B1 (en) 2013-12-16 2020-03-03 Palantir Technologies Inc. Methods and systems for analyzing entity performance
US9727376B1 (en) 2014-03-04 2017-08-08 Palantir Technologies, Inc. Mobile tasks
US10103953B1 (en) 2015-05-12 2018-10-16 Palantir Technologies Inc. Methods and systems for analyzing entity performance
US10296617B1 (en) 2015-10-05 2019-05-21 Palantir Technologies Inc. Searches of highly structured data
US10043102B1 (en) 2016-01-20 2018-08-07 Palantir Technologies Inc. Database systems and user interfaces for dynamic and interactive mobile image analysis and identification
US10642853B2 (en) 2016-12-14 2020-05-05 Palantir Technologies Inc. Automatically generating graphical data displays based on structured descriptions
US11138236B1 (en) 2017-05-17 2021-10-05 Palantir Technologies Inc. Systems and methods for packaging information into data objects

Family Cites Families (128)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0408812B1 (en) * 1989-07-21 2000-03-01 Hewlett-Packard Company Distributed object based systems
US5257365A (en) * 1990-03-16 1993-10-26 Powers Frederick A Database system with multi-dimensional summary search tree nodes for reducing the necessity to access records
US5563999A (en) 1990-10-19 1996-10-08 Moore Business Forms, Inc. Forms automation system
DE69213582T2 (en) * 1991-06-28 1997-03-06 Kao Corp Process for storing objects
US5659724A (en) * 1992-11-06 1997-08-19 Ncr Interactive data analysis apparatus employing a knowledge base
US5420688A (en) 1992-12-14 1995-05-30 Farah; John Interferometric fiber optic displacement sensor
US5405531A (en) * 1993-02-16 1995-04-11 Geo-Microbial Technologies, Inc. Method for reducing the amount of and preventing the formation of hydrogen sulfide in an aqueous system
US5794229A (en) * 1993-04-16 1998-08-11 Sybase, Inc. Database system with methodology for storing a database table by vertically partitioning all columns of the table
US5794228A (en) * 1993-04-16 1998-08-11 Sybase, Inc. Database system with buffer manager providing per page native data compression and decompression
US5455945A (en) * 1993-05-19 1995-10-03 Vanderdrift; Richard System and method for dynamically displaying entering, and updating data from a database
CA2097540C (en) * 1993-06-01 1998-05-12 William G. O'farrell Accessing remote data objects in a distributed memory environment
US5713020A (en) * 1993-09-02 1998-01-27 Microsoft Corporation Method and system for generating database queries containing multiple levels of aggregation
US5553279A (en) * 1993-10-08 1996-09-03 International Business Machines Corporation Lossless distribution of time series data in a relational data base network
US5519859A (en) * 1993-11-15 1996-05-21 Grace; John A. Method and apparatus for automatic table selection and generation of structured query language instructions
KR0128271B1 (en) * 1994-02-22 1998-04-15 윌리암 티. 엘리스 Remote data duplexing
US5537589A (en) * 1994-06-30 1996-07-16 Microsoft Corporation Method and system for efficiently performing database table aggregation using an aggregation index
US5675785A (en) 1994-10-04 1997-10-07 Hewlett-Packard Company Data warehouse which is accessed by a user using a schema of virtual tables
US5511190A (en) * 1995-01-20 1996-04-23 Tandem Computers, Inc. Hash-based database grouping system and method
DE69637733D1 (en) * 1995-02-13 2008-12-11 Intertrust Tech Corp SYSTEMS AND METHOD FOR SAFE TRANSMISSION
US6078925A (en) * 1995-05-01 2000-06-20 International Business Machines Corporation Computer program product for database relational extenders
US5708828A (en) * 1995-05-25 1998-01-13 Reliant Data Systems System for converting data from input data environment using first format to output data environment using second format by executing the associations between their fields
US6026388A (en) * 1995-08-16 2000-02-15 Textwise, Llc User interface and other enhancements for natural language information retrieval system and method
US5721903A (en) * 1995-10-12 1998-02-24 Ncr Corporation System and method for generating reports from a computer database
US5692181A (en) 1995-10-12 1997-11-25 Ncr Corporation System and method for generating reports from a computer database
US5870746A (en) * 1995-10-12 1999-02-09 Ncr Corporation System and method for segmenting a database based upon data attributes
US5832496A (en) 1995-10-12 1998-11-03 Ncr Corporation System and method for performing intelligent analysis of a computer database
US5689566A (en) 1995-10-24 1997-11-18 Nguyen; Minhtam C. Network with secure communications sessions
US5794030A (en) * 1995-12-04 1998-08-11 Objectivity, Inc. System and method for maintenance and deferred propagation of schema changes to the affected objects in an object oriented database
US5884262A (en) * 1996-03-28 1999-03-16 Bell Atlantic Network Services, Inc. Computer network audio access and conversion system
US5706495A (en) * 1996-05-07 1998-01-06 International Business Machines Corporation Encoded-vector indices for decision support and warehousing
US5991742A (en) 1996-05-20 1999-11-23 Tran; Bao Q. Time and expense logging system
JPH09311806A (en) 1996-05-24 1997-12-02 Hitachi Ltd Method for detecting illegal update of data
US5778355A (en) * 1996-06-11 1998-07-07 International Business Machines Corp. Database method and apparatus for interactively retrieving data members and related members from a collection of data
US5721911A (en) * 1996-06-25 1998-02-24 International Business Machines Corporation Mechanism for metadata for an information catalog system
US5870747A (en) * 1996-07-09 1999-02-09 Informix Software, Inc. Generalized key indexes
JPH1055367A (en) * 1996-08-09 1998-02-24 Hitachi Ltd Data utilization system
US5781911A (en) * 1996-09-10 1998-07-14 D2K, Incorporated Integrated system and method of data warehousing and delivery
US5826258A (en) 1996-10-02 1998-10-20 Junglee Corporation Method and apparatus for structuring the querying and interpretation of semistructured information
US5854890A (en) 1996-10-15 1998-12-29 National Instruments Corporation Fieldbus function block shell with user selectable data ownership
US5787415A (en) * 1996-10-30 1998-07-28 International Business Machines Corporation Low maintenance data delivery and refresh system for decision support system database
US6330568B1 (en) * 1996-11-13 2001-12-11 Pumatech, Inc. Synchronization of databases
EP0847019A1 (en) * 1996-12-04 1998-06-10 Koninklijke Philips Electronics N.V. Method and system for selecting an information item in an information processing system, and local station in such a system
US5822751A (en) 1996-12-16 1998-10-13 Microsoft Corporation Efficient multidimensional data aggregation operator implementation
US5848415A (en) 1996-12-18 1998-12-08 Unisys Corporation Selective multiple protocol transport and dynamic format conversion in a multi-user network
US5898431A (en) * 1996-12-31 1999-04-27 International Business Machines Corporation Database graphical user interface with calendar view
US5850547A (en) * 1997-01-08 1998-12-15 Oracle Corporation Method and apparatus for parallel processing aggregates using intermediate aggregate values
US5842213A (en) 1997-01-28 1998-11-24 Odom; Paul S. Method for modeling, storing, and transferring data in neutral form
US5857197A (en) * 1997-03-20 1999-01-05 Thought Inc. System and method for accessing data stores as objects
US6002402A (en) 1997-04-09 1999-12-14 Symantec Corporation System and method for producing a drag-and-drop object from a popup menu item
US5873102A (en) * 1997-04-29 1999-02-16 Oracle Corporation Pluggable tablespaces on a transportable medium
US5794246A (en) * 1997-04-30 1998-08-11 Informatica Corporation Method for incremental aggregation of dynamically increasing database data sets
US6032158A (en) * 1997-05-02 2000-02-29 Informatica Corporation Apparatus and method for capturing and propagating changes from an operational database to data marts
US6078994A (en) * 1997-05-30 2000-06-20 Oracle Corporation System for maintaining a shared cache in a multi-threaded computer environment
US5987454A (en) 1997-06-09 1999-11-16 Hobbs; Allen Method and apparatus for selectively augmenting retrieved text, numbers, maps, charts, still pictures and/or graphics, moving pictures and/or graphics and audio information from a network resource
US6233575B1 (en) * 1997-06-24 2001-05-15 International Business Machines Corporation Multilevel taxonomy based on features derived from training documents classification using fisher values as discrimination values
US6119167A (en) * 1997-07-11 2000-09-12 Phone.Com, Inc. Pushing and pulling data in networks
US5999924A (en) 1997-07-25 1999-12-07 Amazon.Com, Inc. Method and apparatus for producing sequenced queries
JP3922482B2 (en) 1997-10-14 2007-05-30 ソニー株式会社 Information processing apparatus and method
US6122628A (en) * 1997-10-31 2000-09-19 International Business Machines Corporation Multidimensional data clustering and dimension reduction for indexing and searching
US6269369B1 (en) * 1997-11-02 2001-07-31 Amazon.Com Holdings, Inc. Networked personal contact manager
US6014670A (en) * 1997-11-07 2000-01-11 Informatica Corporation Apparatus and method for performing data transformations in data warehousing
US6339775B1 (en) * 1997-11-07 2002-01-15 Informatica Corporation Apparatus and method for performing data transformations in data warehousing
US6128624A (en) 1997-11-12 2000-10-03 Ncr Corporation Collection and integration of internet and electronic commerce data in a database during web browsing
US6151601A (en) 1997-11-12 2000-11-21 Ncr Corporation Computer architecture and method for collecting, analyzing and/or transforming internet and/or electronic commerce data for storage into a data storage area
US6044374A (en) * 1997-11-14 2000-03-28 Informatica Corporation Method and apparatus for sharing metadata between multiple data marts through object references
US6151584A (en) 1997-11-20 2000-11-21 Ncr Corporation Computer architecture and method for validating and collecting and metadata and data about the internet and electronic commerce environments (data discoverer)
EP0944003A1 (en) 1998-03-18 1999-09-22 SONY EUROPE GmbH Notification subsystem
EP0949787A1 (en) 1998-03-18 1999-10-13 Sony International (Europe) GmbH Multiple personality internet account
US6393386B1 (en) * 1998-03-26 2002-05-21 Visual Networks Technologies, Inc. Dynamic modeling of complex networks and prediction of impacts of faults therein
US6032145A (en) * 1998-04-10 2000-02-29 Requisite Technology, Inc. Method and system for database manipulation
US6230151B1 (en) * 1998-04-16 2001-05-08 International Business Machines Corporation Parallel classification for data mining in a shared-memory multiprocessor system
US6065007A (en) * 1998-04-28 2000-05-16 Lucent Technologies Inc. Computer method, apparatus and programmed medium for approximating large databases and improving search efficiency
US6421781B1 (en) * 1998-04-30 2002-07-16 Openwave Systems Inc. Method and apparatus for maintaining security in a push server
US20020056081A1 (en) * 1999-12-02 2002-05-09 Qualcomm Incorporated Apparatus and method for decoding digital image and audio signals
US6141699A (en) 1998-05-11 2000-10-31 International Business Machines Corporation Interactive display system for sequential retrieval and display of a plurality of interrelated data sets
WO1999062033A1 (en) * 1998-05-23 1999-12-02 Eolas Technologies, Incorporated Identification of features of multi-dimensional image data in hypermedia systems
US20020099691A1 (en) * 1998-06-24 2002-07-25 Michael Dean Lore Method and apparatus for aggregation of data in a database management system
US6216125B1 (en) * 1998-07-02 2001-04-10 At&T Corp. Coarse indexes for a data warehouse
US6292657B1 (en) * 1998-07-13 2001-09-18 Openwave Systems Inc. Method and architecture for managing a fleet of mobile stations over wireless data networks
US6208990B1 (en) * 1998-07-15 2001-03-27 Informatica Corporation Method and architecture for automated optimization of ETL throughput in data warehousing applications
US6192364B1 (en) * 1998-07-24 2001-02-20 Jarg Corporation Distributed computer database system and method employing intelligent agents
US6269336B1 (en) * 1998-07-24 2001-07-31 Motorola, Inc. Voice browser for interactive services and methods thereof
US6446096B1 (en) * 1998-09-11 2002-09-03 International Business Machines Corporation Method and system for providing device-specific key control using role-based HTML element tags
US6480711B1 (en) 1998-09-15 2002-11-12 Nms Communications Corporation Method and system for wireless data communication over the internet
US6154783A (en) * 1998-09-18 2000-11-28 Tacit Knowledge Systems Method and apparatus for addressing an electronic document for transmission over a network
AU6412099A (en) * 1998-10-02 2000-04-26 Ncr Corporation Data mining assists in a relational database management system
US6385583B1 (en) * 1998-10-02 2002-05-07 Motorola, Inc. Markup language for interactive services and methods thereof
US6826556B1 (en) * 1998-10-02 2004-11-30 Ncr Corporation Techniques for deploying analytic models in a parallel
JP3361066B2 (en) * 1998-11-30 2003-01-07 松下電器産業株式会社 Voice synthesis method and apparatus
US6477525B1 (en) 1998-12-28 2002-11-05 Oracle Corporation Rewriting a query in terms of a summary based on one-to-one and one-to-many losslessness of joins
US6457030B1 (en) * 1999-01-29 2002-09-24 International Business Machines Corporation Systems, methods and computer program products for modifying web content for display via pervasive computing devices
US6411936B1 (en) * 1999-02-05 2002-06-25 Nval Solutions, Inc. Enterprise value enhancement system and method
US6272485B1 (en) * 1999-02-18 2001-08-07 Creative Internet Applications, Inc. Transferring selected formatted documents over a computer network using interface script
US6418200B1 (en) * 1999-02-26 2002-07-09 Mitel, Inc. Automatic synchronization of address directories for unified messaging
US6563912B1 (en) * 1999-03-02 2003-05-13 Toshiba America Information Systems, Inc. System and method for providing integrated messaging
GB2347567A (en) * 1999-03-05 2000-09-06 Sharp Kk CMOS level shifters and sense amplifiers
US6369840B1 (en) * 1999-03-10 2002-04-09 America Online, Inc. Multi-layered online calendaring and purchasing
US6272598B1 (en) 1999-03-22 2001-08-07 Hewlett-Packard Company Web cache performance by applying different replacement policies to the web cache
US6173310B1 (en) * 1999-03-23 2001-01-09 Microstrategy, Inc. System and method for automatic transmission of on-line analytical processing system report output
US6574599B1 (en) * 1999-03-31 2003-06-03 Microsoft Corporation Voice-recognition-based methods for establishing outbound communication through a unified messaging system including intelligent calendar interface
US6535872B1 (en) * 1999-04-08 2003-03-18 International Business Machines Corporation Method and apparatus for dynamically representing aggregated and segmented data views using view element sets
US6446059B1 (en) * 1999-06-22 2002-09-03 Microsoft Corporation Record for a multidimensional database with flexible paths
US6449619B1 (en) * 1999-06-23 2002-09-10 Datamirror Corporation Method and apparatus for pipelining the transformation of information between heterogeneous sets of data sources
JP4251726B2 (en) * 1999-07-08 2009-04-08 三菱電機株式会社 File management method
US6549937B1 (en) * 1999-07-21 2003-04-15 Microsoft Corporation System and method for multi-protocol communication in a computer network
US6385604B1 (en) * 1999-08-04 2002-05-07 Hyperroll, Israel Limited Relational database management system having integrated non-relational multi-dimensional data store of aggregated data elements
US6408292B1 (en) * 1999-08-04 2002-06-18 Hyperroll, Israel, Ltd. Method of and system for managing multi-dimensional databases using modular-arithmetic based address data mapping processes on integer-encoded business dimensions
US6404884B1 (en) * 1999-10-08 2002-06-11 Grape Technology Group, Inc. Personalized assistance system and method
US6430624B1 (en) * 1999-10-21 2002-08-06 Air2Web, Inc. Intelligent harvesting and navigation system and method
US6564264B1 (en) * 1999-12-08 2003-05-13 At&T Corp. System, apparatus and method for automatic address updating of outgoing and incoming user messages in a communications network
US6446062B1 (en) * 1999-12-23 2002-09-03 Bull Hn Information Systems Inc. Method and apparatus for improving the performance of a generated code cache search operation through the use of static key values
US6526335B1 (en) * 2000-01-24 2003-02-25 G. Victor Treyz Automobile personal computer systems
US6581062B1 (en) * 2000-03-02 2003-06-17 Nimble Technology, Inc. Method and apparatus for storing semi-structured data in a structured manner
US6424426B1 (en) * 2000-03-28 2002-07-23 Mongonet Fax-to-email and email-to-fax communication system and method
US6336137B1 (en) * 2000-03-31 2002-01-01 Siebel Systems, Inc. Web client-server system and method for incompatible page markup and presentation languages
US20020112237A1 (en) * 2000-04-10 2002-08-15 Kelts Brett R. System and method for providing an interactive display interface for information objects
AU2001257077A1 (en) * 2000-04-17 2001-10-30 Brio Technology, Inc. Analytical server including metrics engine
US6748394B2 (en) * 2000-04-27 2004-06-08 Hyperion Solutions Corporation Graphical user interface for relational database
US6601062B1 (en) * 2000-06-27 2003-07-29 Ncr Corporation Active caching for multi-dimensional data sets in relational database management system
US6629102B1 (en) * 2000-07-28 2003-09-30 International Business Machines Corporation Efficiently updating a key table during outline restructure of a multi-dimensional database
DE20016803U1 (en) * 2000-09-29 2000-12-28 Heimbach Gmbh Thomas Josef Filter device
BR0116693A (en) * 2000-12-18 2004-08-17 Wireless Valley Comm Inc Computer system and method for collecting data from a spatially distributed object group or network and method for visualizing a spatially distributed object group or network
US6721728B2 (en) * 2001-03-02 2004-04-13 The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration System, method and apparatus for discovering phrases in a database
CA2451992C (en) * 2001-05-15 2013-08-27 Psychogenics Inc. Systems and methods for monitoring behavior informatics
US7024401B2 (en) * 2001-07-02 2006-04-04 International Business Machines Corporation Partition boundary determination using random sampling on very large databases
US7249118B2 (en) * 2002-05-17 2007-07-24 Aleri, Inc. Database system and methods
US20040010538A1 (en) * 2002-07-11 2004-01-15 International Business Machines Corporation Apparatus and method for determining valid data during a merge in a computer cluster
US8768441B2 (en) * 2003-10-20 2014-07-01 Zoll Medical Corporation Time coordination and synchronization of event times in electronic medical records

Also Published As

Publication number Publication date
US20050125436A1 (en) 2005-06-09
WO2005060461A2 (en) 2005-07-07
EP1690158A4 (en) 2010-06-02
EP1690158A2 (en) 2006-08-16
US7254590B2 (en) 2007-08-07
CA2542109C (en) 2012-03-20
WO2005060461A3 (en) 2007-02-01

Similar Documents

Publication Publication Date Title
CA2542109A1 (en) Set-oriented real-time data processing based on transaction boundaries
US20190034485A1 (en) System and method for optimizing large database management systems with multiple optimizers
US10007700B2 (en) Query optimization for group-by extensions and distinct aggregate functions
US7318058B2 (en) System and method of processing queries
US8554761B1 (en) Transforming a single-table join predicate into a pseudo-join predicate
US8315980B2 (en) Parallel execution of window functions
US9195701B2 (en) System and method for flexible distributed massively parallel processing (MPP) database
DE202020005722U1 (en) Placement of adaptive aggregation operators and properties in a query plan
CN105138621B (en) A kind of Sybase ASE database configuration optimization system and method
DE10056763A1 (en) Generating restriction queries using tensor representations involves storing relation with tuples formed over several attributes in relational tensor with orders corresponding to attributes
CN106991116B (en) Optimization method and device for database execution plan
Sahal et al. Big data multi-query optimisation with Apache Flink
RU2396593C2 (en) Method for searching data on objects and in various databases and system for its realisation
Rohde et al. Optimizing federated queries based on the physical design of a data lake
CN111399838A (en) Data modeling method and device based on spark SQ L and materialized view
Bellatreche et al. Partjoin: An efficient storage and query execution for data warehouses
Agarwal et al. An approach to mine frequent item sets considering negative item values
US20230214390A1 (en) Cost-based semi-join rewrite
Bhanderi et al. Parallel frequent set mining using inverted matrix approach
Necir A data mining approach for efficient selection bitmap join index
KR20130008333A (en) Convergence database management system using database manager , and the method
Beiraimi et al. Towards Optimal Snapshot Materialization To Support Large Query Workload For Append-only Temporal Databases
Fallahpour et al. Comparison of wrapper and filtering approaches for corporate failure prediction
Su et al. ACORE: A Query Optimization Approach for Spark SQL Based on Cost Model and Markov Prediction Model
Huang et al. Two-stage stochastic view selection for data-analysis queries

Legal Events

Date Code Title Description
EEER Examination request