CA2150745A1 - Method and apparatus for implementing partial declustering in a parallel database system - Google Patents

Method and apparatus for implementing partial declustering in a parallel database system

Info

Publication number
CA2150745A1
CA2150745A1 CA002150745A CA2150745A CA2150745A1 CA 2150745 A1 CA2150745 A1 CA 2150745A1 CA 002150745 A CA002150745 A CA 002150745A CA 2150745 A CA2150745 A CA 2150745A CA 2150745 A1 CA2150745 A1 CA 2150745A1
Authority
CA
Canada
Prior art keywords
partitioning
declustering
database system
parallel database
nodes
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CA002150745A
Other languages
French (fr)
Other versions
CA2150745C (en
Inventor
Chaitanya K. Baru
Gilles Fecteau
Jo-Anne Kirton
Lubor J. Kollar
Fred Koo
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
IBM Canada Ltd
Original Assignee
IBM Canada Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by IBM Canada Ltd filed Critical IBM Canada Ltd
Priority to CA002150745A priority Critical patent/CA2150745C/en
Priority to US08/630,264 priority patent/US5878409A/en
Publication of CA2150745A1 publication Critical patent/CA2150745A1/en
Application granted granted Critical
Publication of CA2150745C publication Critical patent/CA2150745C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • G06F16/278—Data partitioning, e.g. horizontal or vertical partitioning
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00—Data processing: database and file management or data structures
    • Y10S707/99931—Database or file accessing
    • Y10S707/99932—Access augmentation or optimizing
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00—Data processing: database and file management or data structures
    • Y10S707/99951—File or database maintenance
    • Y10S707/99952—Coherency, e.g. same view to multiple users
    • Y10S707/99953—Recoverability

Abstract

The invention provides a method and apparatus for distributing data of a table across a parallel data base system having a plurality of interlinked database nodes. The table is partitioned in accordance with a predetermined partitioning arrangement and data of the table is distributed across a subset of the nodes in accordance with the partitioning arrangement. The partitioning arrangement can comprise horizontal or vertical partitioning. The partitioning arrangement can comprise a partitioning map defining the relationship of partitions of the table to said subset of nodes.
CA002150745A 1995-06-01 1995-06-01 Method and apparatus for implementing partial declustering in a parallel database system Expired - Fee Related CA2150745C (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CA002150745A CA2150745C (en) 1995-06-01 1995-06-01 Method and apparatus for implementing partial declustering in a parallel database system
US08/630,264 US5878409A (en) 1995-06-01 1996-04-10 Method and apparatus for implementing partial declustering in a parallel database system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CA002150745A CA2150745C (en) 1995-06-01 1995-06-01 Method and apparatus for implementing partial declustering in a parallel database system

Publications (2)

Publication Number Publication Date
CA2150745A1 true CA2150745A1 (en) 1996-12-02
CA2150745C CA2150745C (en) 2001-05-01

Family

ID=4155969

Family Applications (1)

Application Number Title Priority Date Filing Date
CA002150745A Expired - Fee Related CA2150745C (en) 1995-06-01 1995-06-01 Method and apparatus for implementing partial declustering in a parallel database system

Country Status (2)

Country Link
US (1) US5878409A (en)
CA (1) CA2150745C (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2406736A2 (en) * 2009-03-11 2012-01-18 Oracle International Corporation Composite hash and list partitioning of database tables
US8583687B1 (en) 2012-05-15 2013-11-12 Algebraix Data Corporation Systems and methods for indirect algebraic partitioning

Families Citing this family (46)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3510042B2 (en) * 1996-04-26 2004-03-22 株式会社日立製作所 Database management method and system
JP3747525B2 (en) * 1996-08-28 2006-02-22 株式会社日立製作所 Parallel database system search method
US6240428B1 (en) * 1997-10-31 2001-05-29 Oracle Corporation Import/export and repartitioning of partitioned objects
US6269375B1 (en) * 1998-04-01 2001-07-31 International Business Machines Corporation Rebalancing partitioned data
DE69811477T2 (en) * 1998-05-01 2003-11-20 Hewlett Packard Co Hash coding method and apparatus
US7089331B1 (en) * 1998-05-29 2006-08-08 Oracle International Corporation Method and mechanism for reducing client-side memory footprint of transmitted data
US6415297B1 (en) * 1998-11-17 2002-07-02 International Business Machines Corporation Parallel database support for workflow management systems
NO992269D0 (en) * 1999-05-10 1999-05-10 Fast Search & Transfer Asa ° engine with two-dimensional scalable, parallel architecture
US6272498B1 (en) * 1999-07-22 2001-08-07 Lucent Technologies Inc. Method for partitioning multi-dimensional data sets into rectangular partitions
US6412054B1 (en) * 1999-08-09 2002-06-25 Lucent Technologies Inc. Storage disk declustering method
US20020029207A1 (en) * 2000-02-28 2002-03-07 Hyperroll, Inc. Data aggregation server for managing a multi-dimensional database and database management system having data aggregation server integrated therein
US6954776B1 (en) * 2001-05-07 2005-10-11 Oracle International Corporation Enabling intra-partition parallelism for partition-based operations
AU2002217653A1 (en) * 2001-12-12 2003-07-09 Telefonaktiebolaget Lm Ericsson (Publ) Collision handling apparatus and method
US7610351B1 (en) 2002-05-10 2009-10-27 Oracle International Corporation Method and mechanism for pipelined prefetching
US8583657B2 (en) * 2004-05-06 2013-11-12 Oracle International Corporation Method and apparatus for using a hash-partitioned index to access a table that is not partitioned or partitioned independently of the hash partitioned index
US8229893B2 (en) * 2010-02-01 2012-07-24 Hitachi Data Systems Corporation Metadata management for fixed content distributed data storage
US8996482B1 (en) * 2006-02-10 2015-03-31 Amazon Technologies, Inc. Distributed system and method for replicated storage of structured data records
US8447829B1 (en) 2006-02-10 2013-05-21 Amazon Technologies, Inc. System and method for controlling access to web services resources
US8671091B2 (en) * 2006-08-02 2014-03-11 Hewlett-Packard Development Company, L.P. Optimizing snowflake schema queries
US8086598B1 (en) 2006-08-02 2011-12-27 Hewlett-Packard Development Company, L.P. Query optimizer with schema conversion
US10007686B2 (en) * 2006-08-02 2018-06-26 Entit Software Llc Automatic vertical-database design
US7680766B2 (en) * 2007-03-29 2010-03-16 Redknee Inc. Method and apparatus for adding a database partition
US20100115246A1 (en) * 2008-10-31 2010-05-06 Yahoo! Inc. System and method of data partitioning for parallel processing of dynamically generated application data
US8904381B2 (en) * 2009-01-23 2014-12-02 Hewlett-Packard Development Company, L.P. User defined data partitioning (UDP)—grouping of data based on computation model
US8700674B2 (en) * 2009-07-14 2014-04-15 Hewlett-Packard Development Company, L.P. Database storage architecture
US20110029319A1 (en) * 2009-07-29 2011-02-03 Google Inc. Impression forecasting and reservation analysis
US8290931B2 (en) * 2010-02-22 2012-10-16 Hewlett-Packard Development Company, L.P. Database designer
US9104674B1 (en) 2010-04-14 2015-08-11 Inmar, Inc. System, method and computer program product for time sharing access control to data
US20120036146A1 (en) 2010-10-26 2012-02-09 ParElastic Corporation Apparatus for elastic database processing with heterogeneous data
US8543538B2 (en) 2011-06-01 2013-09-24 Clustrix, Inc. Systems and methods for redistributing data in a relational database
US8918436B2 (en) 2011-12-22 2014-12-23 Sap Ag Hybrid database table stored as both row and column store
CN103336792B (en) * 2013-06-07 2016-11-23 华为技术有限公司 Data partition method and device
US10289723B1 (en) * 2014-08-21 2019-05-14 Amazon Technologies, Inc. Distributed union all queries
US10180973B2 (en) 2014-09-26 2019-01-15 Oracle International Corporation System and method for efficient connection management in a massively parallel or distributed database environment
US10089357B2 (en) 2014-09-26 2018-10-02 Oracle International Corporation System and method for generating partition-based splits in a massively parallel or distributed database environment
US10528596B2 (en) 2014-09-26 2020-01-07 Oracle International Corporation System and method for consistent reads between tasks in a massively parallel or distributed database environment
US10394818B2 (en) 2014-09-26 2019-08-27 Oracle International Corporation System and method for dynamic database split generation in a massively parallel or distributed database environment
US10078684B2 (en) 2014-09-26 2018-09-18 Oracle International Corporation System and method for query processing with table-level predicate pushdown in a massively parallel or distributed database environment
US10380114B2 (en) * 2014-09-26 2019-08-13 Oracle International Corporation System and method for generating rowid range-based splits in a massively parallel or distributed database environment
US10387421B2 (en) 2014-09-26 2019-08-20 Oracle International Corporation System and method for generating size-based splits in a massively parallel or distributed database environment
US10089377B2 (en) 2014-09-26 2018-10-02 Oracle International Corporation System and method for data transfer from JDBC to a data warehouse layer in a massively parallel or distributed database environment
JP2015146205A (en) * 2015-03-16 2015-08-13 株式会社東芝 Database processing method and database processing apparatus
US10817540B2 (en) * 2016-09-02 2020-10-27 Snowflake Inc. Incremental clustering maintenance of a table
US10534765B2 (en) * 2017-04-07 2020-01-14 Micro Focus Llc Assigning segments of a shared database storage to nodes
US11157496B2 (en) 2018-06-01 2021-10-26 International Business Machines Corporation Predictive data distribution for parallel databases to optimize storage and query performance
US11163764B2 (en) 2018-06-01 2021-11-02 International Business Machines Corporation Predictive data distribution for parallel databases to optimize storage and query performance

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5448727A (en) * 1991-04-30 1995-09-05 Hewlett-Packard Company Domain based partitioning and reclustering of relations in object-oriented relational database management systems
JP3269849B2 (en) * 1992-05-29 2002-04-02 株式会社日立製作所 Parallel database processing system and its retrieval method
JP2583010B2 (en) * 1993-01-07 1997-02-19 インターナショナル・ビジネス・マシーンズ・コーポレイション Method of maintaining consistency between local index table and global index table in multi-tier index structure
US5689678A (en) * 1993-03-11 1997-11-18 Emc Corporation Distributed storage array system having a plurality of modular control units
US5546575A (en) * 1994-05-23 1996-08-13 Basil E. Potter & Associates, Inc. Encoding method for compressing a tabular database by selecting effective compression routines for each field and structure of partitions of equal sized records
US5530658A (en) * 1994-12-07 1996-06-25 International Business Machines Corporation System and method for packing heat producing devices in an array to prevent local overheating
US5710938A (en) * 1995-07-19 1998-01-20 Unisys Corporation Data processing array in which sub-arrays are established and run independently

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2406736A2 (en) * 2009-03-11 2012-01-18 Oracle International Corporation Composite hash and list partitioning of database tables
EP2406736A4 (en) * 2009-03-11 2014-04-02 Oracle Int Corp Composite hash and list partitioning of database tables
US8583687B1 (en) 2012-05-15 2013-11-12 Algebraix Data Corporation Systems and methods for indirect algebraic partitioning

Also Published As

Publication number Publication date
CA2150745C (en) 2001-05-01
US5878409A (en) 1999-03-02

Similar Documents

Publication Publication Date Title
CA2150745A1 (en) Method and apparatus for implementing partial declustering in a parallel database system
CA2159269A1 (en) Method and Apparatus for Achieving Uniform Data Distribution in a Parallel Database System
EP0551009A3 (en) Method for synchronizing reserved areas in a redundant storage array
WO2003038760A8 (en) Apparatus and method for distributing representative images in partitioned areas of a three-dimensional graphical environment
DE69615230T2 (en) Relational database system and method with high availability of data when restructuring table data
CA2232938A1 (en) Method and apparatus for performing a join query in a database system
CA2220274A1 (en) Method and apparatus for seismic signal processing and exploration
CA2135023A1 (en) Ultrasonic cleaning apparatus for and method of cleaning chandeliers
GB2224414B (en) Apparatus and method for obtaining frequency agility in time division multiple access systems
DE69425993T2 (en) Device for expanding partitions
DE59607181D1 (en) INFORMATION SYSTEM AND METHOD FOR STORING DATA IN AN INFORMATION SYSTEM
EP0428264A3 (en) A method for generating an access plan in a database system
EP0376420A3 (en) Method and apparatus for generic form generation
DE69331440D1 (en) METHOD AND SYSTEM FOR MAKING REMOTE PROCESS CALLS IN A DISTRIBUTED COMPUTER SYSTEM.
DE3877829T2 (en) PRESENTATION SYSTEM WITH TRANSPARENT SCREEN AND METHOD FOR THE PRODUCTION THEREOF.
DE69628191T2 (en) SEISMIC METHOD FOR VERTICAL SEISMIC PROFILE DATA ACQUISITION WITH A MULTIPLE NUMBER OF SIGNAL-LIKE SEISMIC VIBRATION SOURCES
DE69431287T2 (en) TRANSMISSION TIME ADJUSTMENT IN THE DOWNWARD CONNECTION OF A SYSTEM WITH CODEMULTIPLEX MULTIPLE ACCESS
EP0661752A3 (en) Dynamic random access memory device and method for producing the same.
GB9402727D0 (en) Method for simulating Crosswell Seismic Data
BR8401456A (en) FILLING DISTRIBUTION EQUIPMENT, EQUIPMENT FOR MEASURING AND DISTRIBUTING PREDETERMINATED QUANTITIES OF LIQUID ADDITIVE AND DISTRIBUTOR FILLING PROCESS
EP0726536A3 (en) Relational data base system and method
WO1998030054A3 (en) Frequency assigning method in a seven cell frequency plan for a cellular communications system without adjacent frequencies
ES8507707A1 (en) Raster scan display system with plural storage devices.
DE69701256D1 (en) DATABASE SYSTEM WITH INDIVIDUAL ASSOCIATION STRUCTURES AND METHOD FOR SEARCHING DATA IN DATABASE SYSTEMS
EP0213276A3 (en) Dynamic updating of data base directories

Legal Events

Date Code Title Description
EEER Examination request
MKLA Lapsed