WO2011051098A1 - Synchronizing database and non-database resources - Google Patents

Synchronizing database and non-database resources Download PDF

Info

Publication number
WO2011051098A1
WO2011051098A1 PCT/EP2010/065101 EP2010065101W WO2011051098A1 WO 2011051098 A1 WO2011051098 A1 WO 2011051098A1 EP 2010065101 W EP2010065101 W EP 2010065101W WO 2011051098 A1 WO2011051098 A1 WO 2011051098A1
Authority
WO
WIPO (PCT)
Prior art keywords
file
service provider
application
entry
database
Prior art date
Application number
PCT/EP2010/065101
Other languages
French (fr)
Inventor
Erika Marianna Dawson
Kevin Goldsmith
Brian Corkill
Colin Scott Dawson
Original Assignee
International Business Machines Corporation
Ibm United Kingdom Limited
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by International Business Machines Corporation, Ibm United Kingdom Limited filed Critical International Business Machines Corporation
Priority to GB1201716.6A priority Critical patent/GB2487139A/en
Priority to CN201080049531.XA priority patent/CN102597995B/en
Priority to DE112010004185.7T priority patent/DE112010004185B4/en
Publication of WO2011051098A1 publication Critical patent/WO2011051098A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23Updating
    • G06F16/2308Concurrency control
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23Updating
    • G06F16/2379Updates performed during online database operations; commit processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/18File system types
    • G06F16/1865Transactional file systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • G06F16/252Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application

Definitions

  • This invention relates to database and non-database resources, and more particularly to apparatus and methods for performing commit coordination for database and non-database resources.
  • a database transaction is a unit of work performed by a database management system (DBMS) or other application associated with a database. Transactions are generally performed using an "all-or-nothing" approach, meaning that all work units associated with a transaction must complete or none must complete.
  • a "commit coordinator" built into a DBMS or application may ensure that a transaction completes in its entirety or not at all.
  • a transaction may be defined as an indivisible unit of work.
  • a transaction may terminate in one of two different ways, namely with a COMMIT or a ROLLBACK statement.
  • a COMMIT statement hereinafter referred to as a "COMMIT"
  • data modifications specified by the transaction are made permanent in the database.
  • a ROLLBACK statement hereinafter referred to as a "ROLLBACK”
  • ROLLBACK may be used to undo the effects of all statements in the transaction. For example, if a disk drive were to crash during the "credit savings account” step listed above, a ROLLBACK statement could be executed in order to undo the data modifications made by the "debit checking account” statement. Although the transaction failed, data integrity would remain intact to keep the accounts balanced.
  • an application may perform certain actions or cause certain actions to occur that fall outside of the application's normal "commit coordination.” For example, consider an application that invokes, as part of a transaction, a service provider to perform some action, such as store a large image file in a file system. The service provider and file system may have no knowledge of the transaction. Thus, the actions performed by the service provider may fall outside the application's "commit coordination.” In other words, the application may be unable to reverse actions performed by the service provider if the application ultimately performs a ROLLBACK. Likewise, the service provider may have no knowledge of the ROLLBACK and thus will also be unable to take actions to reverse the action. Using the above example, such a scenario may lead to orphaned files in the file system that were not reversed (i.e., deleted from the file system) in response to a
  • the invention has been developed in response to the present state of the art and, in particular, in response to the problems and needs in the art that have not yet been fully solved by currently available apparatus and methods. Accordingly, the invention has been developed to provide apparatus and methods for performing commit coordination for database and non-database resources.
  • a system to synchronize a database and a non-database resource includes an application to transmit a request to a service provider to store an object.
  • the service provider receives the request and stores the object as a file, wherein the file is a non-database resource.
  • the service provider further inserts an entry into a new file-deletion table to delete the file and makes the insertion permanent by performing a COMMIT.
  • the service provider on behalf of the application, is configured to delete the entry from the file-deletion table.
  • the application may then perform one of the following: (1) make the delete permanent by performing a COMMIT; and (2) roll back the delete by performing a ROLLBACK.
  • the service provider is configured to delete the file in the event the entry remains in the file-deletion-table. In this way, a file system that is not under commit coordination may be synchronized with an application that is under commit coordination.
  • a system to synchronize a database and a non-database resource includes an application to transmit a request to a service provider to perform an action.
  • the service provider receives the request and performs the action, the action not being under commit coordination.
  • the service provider further inserts an entry into an action-reversal table to reverse the action and makes the insertion permanent by performing a COMMIT.
  • the service provider on behalf of the application, then deletes the entry from the action-reversal table.
  • the application may then be configured to perform one of the following: (1) make the delete permanent by performing a COMMIT; and (2) roll back the delete by performing a ROLLBACK.
  • the service provider is configured to reverse the action in the event the entry remains in the action-reversal table.
  • Figure 1 is a high-level block diagram showing one example of an environment where an apparatus and method in accordance with the invention may operate;
  • Figure 2 is a flow diagram showing one embodiment of a method for synchronizing a database and a non-database resource when a ROLLBACK is performed;
  • Figure 3 shows the state of various data structures at different points in time when a ROLLBACK is performed
  • Figure 4 is a flow diagram showing one embodiment of a method for synchronizing a database and a non-database resource when a COMMIT is performed;
  • Figure 5 shows the state of various data structures at different points in time when a COMMIT is performed
  • FIG. 6 is a high-level block diagram showing various modules that may be included in a service provider in accordance with the invention.
  • Figure 7 is a flow diagram showing an alternative embodiment of a method for synchronizing a database and a non-database resource when a COMMIT and/or
  • the present invention may be embodied as an apparatus, system, method, computer-readable medium, or computer program product.
  • the present invention may take the form of a hardware embodiment, a software embodiment (including firmware, resident software, micro-code, etc.) configured to operate hardware, or an embodiment combining software and hardware aspects that may generally be referred to herein as a "module” or "system.”
  • the present invention may take the form of a computer program product embodied in any tangible medium of expression having computer-usable program code stored therein.
  • the computer-usable or computer-readable medium may be, for example but not limited to, an electronic, magnetic, optical,
  • a computer-readable medium may include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CDROM), an optical storage device, or a magnetic storage device.
  • a computer-usable or computer-readable medium may be any medium that can contain, store, or transport a program for use by or in connection with the instruction execution system, apparatus, or device.
  • Computer program code for carrying out operations of the present invention may be written in any combination of one or more programming languages, including an object-oriented programming language such as Java, Smalltalk, C++, or the like, and conventional procedural programming languages, such as the "C" programming language or similar programming languages.
  • the program code may execute entirely on a user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server.
  • the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).
  • LAN local area network
  • WAN wide area network
  • Internet Service Provider for example, AT&T, MCI, Sprint, EarthLink, MSN, GTE, etc.
  • Embodiments of the invention are described below with reference to flowchart illustrations and/or block diagrams of methods, apparatus, systems, computer-readable mediums, and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions or code. These computer program instructions may be provided to a processor of a general-purpose computer, special-purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
  • These computer program instructions may also be stored in a computer-readable medium that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable medium produce an article of manufacture including instruction means which implement the function/act specified in the flowchart and/or block diagram block or blocks.
  • the computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
  • FIG 1 one example of an environment 100 where an apparatus and method in accordance with the invention may operate is illustrated. In this example, the
  • the environment 100 includes an application 102 configured to access a database comprising one or more database tables 104.
  • This database may be accessed by way of a database management system 106 (e.g., DB2 or analogous DBMS 106).
  • the database tables 104 are stored on disk drives 108 or other suitable storage devices such as solid-state drives 108 (i.e., SSDs).
  • the application 102 may be responsible for
  • the application 102 may initiate "commit coordination" for data stored in the database tables 104.
  • the application 102 may communicate with a service provider 110 (such as "Object Access Method” (OAM) or other service provider) to provide one or more services.
  • a service provider 110 such as "Object Access Method” (OAM) or other service provider
  • the service provider 110 may enable the application 102 to store and retrieve "objects" in one or more storage devices, such as disk drives 112, optical drives 114, or tape drives 116.
  • the service provider 110 may enable the application to store one or more objects as files in a file system 1 18.
  • the application 102 may communicate with a service provider 110 (such as "Object Access Method” (OAM) or other service provider) to provide one or more services.
  • OAM Object Access Method
  • the service provider 110 may enable the application 102 to store and retrieve "objects" in one or more storage devices, such as disk drives 112, optical drives 114, or tape drives 116.
  • the service provider 110 may enable the application to store one or more objects as files in a file system 1 18.
  • the application 102 may
  • an application programming interface 122 such as the OSREQ API where the service provider is OAM.
  • An "object” may, in certain embodiments, include any named sequence of bytes.
  • an object could be image data (such as a compressed scanned image) or coded data.
  • the service provider 110 may have no knowledge of the content, format, and/or structure of the sequence of bytes.
  • metadata for the object may be stored in a database table 104, such as an object directory table 120.
  • This metadata may include information to locate and manage the object, among other information.
  • the service provider 110 may add a row (i.e., entry) to the object directory table 120 containing metadata for the stored object. However, the application 102 and not the service provider 110 may perform the COMMIT for that row. If the application ultimately performs a ROLLBACK, this will delete the entry for the object from the object directory table 120 but may leave the object orphaned in the file system 1 18. In other words, because the file system 1 18 is not under the "commit coordination" of the DBMS 106, the object may continue to exist in the file system 1 18 even though the record for the object has been deleted from the object directory table
  • the store operation may fail because the named object already exists in the file system 1 18.
  • a file-deletion table 124 is provided to act as a proxy for a resource residing outside a DBMS's commit coordination.
  • the file- deletion table 124 is under the DBMS's commit coordination and therefore be used to keep non-database resources synchronized and consistent with database resources.
  • the function and operation of the file-deletion table 124 as well as other functionality will be described in more detail in association with Figures 2 through 5.
  • the application 102, DBMS 106, and service provider 1 10 run within the same host operating system 126 residing on a host system 128 (e.g., a mainframe computer or other computing system).
  • a host system 128 e.g., a mainframe computer or other computing system.
  • the components 102, 106, 1 10 do not necessarily need to run on the same operating system 126 or host system 128.
  • the components 102, 106, 1 10 may operate in different operating systems 126 or run on different host systems 128.
  • the components 102, 106, 1 10 may operate on different computers that communicate with each other over a network (e.g., a network (e.g., a network).
  • FIG. 2 one embodiment of a method 200 for synchronizing a database and a non-database resource is illustrated.
  • the method 200 of Figure 2 shows a scenario where an application 102 performs a ROLLBACK of the work it has performed.
  • Figure 3 shows the states of various data structures at different points in time as the method 200 executes.
  • the application 102 (operating under an application thread 202) initially transmits 208 a request to a service provider 110 to store a named object.
  • the service provider 110 (operating under a separate service thread 204) then generates 210 a unique identifier for the named object in order to differentiate the instance of the object from other instances of the named object. This differentiation may be important since the contents of an instance of a named object can be different from the contents of another instance of the same named object.
  • the service provider 110 then stores 212 the named object as a file with a unique identifier in the file system 118. For example, as shown in Figure 3, at time T l s an object named myfile with the unique identifier "7" is stored as my file.7 in the file system 118.
  • the service provider 110 adds 214 a "delete" entry to the file-deletion table 124 for the named object.
  • the service provider may then perform 214 a COMMIT for this entry on the service thread 204 to make the entry permanent in the file-deletion table 124.
  • the service provider 110 inserts the entry delete myfile.7 into the file-deletion table (FDT) 124. In essence, this makes the deletion of the file the default action to be performed by the service provider 110.
  • FDT file-deletion table
  • the service provider 110 then adds 216 the named object to the object directory table 120, thereby indicating that the named object is stored in the file system 118. As shown at time T 3 , the service provider 110 inserts metadata for the named object into the object directory table 120. The service provider 110 then deletes 218 the entry from the file-deletion table 124 with the intent of eliminating the request to delete the named object. For example, as shown at time T 4 , the service provider 110 removes the delete myfile.7 entry from the file-deletion table 124. The permanence of this deletion from the file-deletion table 124 will depend on the ultimate disposition of the transaction, and more specifically whether a COMMIT or
  • ROLLBACK is ultimately executed by the application 102.
  • the application 102 eventually performs 220 a ROLLBACK, thereby reversing the work performed by the application 102. This will roll back the deletion of the delete myfile.7 entry, thereby adding it back to the file-deletion table 124.
  • the delete myfile.7 entry is restored to the file-deletion table 124 and the object's entry in the object directory table 120 is deleted. Note that the actual file remains in the file system 118. Further note that the service provider 110 is unaware that the application 102 has disposed of the transaction by performing a ROLLBACK.
  • a cleanup thread 206 is executed by the service provider 110 at some future point in time.
  • the service provider 110 initially retrieves entries from the file-deletion table 124 that are older than some interval n.
  • the interval n may be selected such as to allow the application 102 enough time to dispose of the transaction (perform either a COMMIT or a
  • This interval n may be on the order of seconds, minutes, hours, days, or weeks, depending on the application 102.
  • the service provider 110 deletes the file specified by the entry in the file-deletion table 124. This will synchronize the file system 118 with the object directory table 120, where the entry for the named object was already deleted by the ROLLBACK 220. As shown in Figure 3, at time T 6 , the file myfile.7 is deleted from the file system 118. Finally, the service provider 110 deletes the entry from the file-deletion table 124 requesting the deletion of the named object. The service provider 110 performs a COMMIT for this change on the cleanup thread 206 to make it permanent. Thus, as shown at time T 7 , the delete myfile.7 entry is deleted from the file-deletion table 124.
  • the application 102 may continue to perform actions for the same named object, even if the previous instance of the named object has still not been deleted from the file system 118. For example, if the application 102 were to attempt to store the same named object again before the previous instance had been deleted, the service provider 110 would generate a new unique identifier for the new instance ⁇ e.g., my file.8). This instance could then be stored in the file system 118 without incurring an error due to a duplicate file name.
  • FIG 4 another embodiment of a method 400 for synchronizing a database and a non-database resource is illustrated.
  • the method 400 of Figure 4 shows a scenario wherein the application 102 performs a COMMIT.
  • Figure 5 shows the states of various data structures at different points in time as the method 400 is executed.
  • the method 400 is the same as the method 200 illustrated in Figure 2 up until the time the application 102 performs 420 a COMMIT (instead of a ROLLBACK).
  • the application 102 performs 420 a COMMIT, thereby making work performed by the application 102 permanent. This will permanently delete the delete myfile.7 entry from the file-deletion table 124. Thus, as shown at time T5 in Figure 5, the delete myfile.7 entry is removed from the file-deletion table 124. The entry in the object directory table 120, however, is retained. Like the previous example, the service provider 110 is unaware that the application 102 has performed the COMMIT.
  • a cleanup thread 406 is executed by the service provider 110 at some future point in time. Because the entry for the named object has been removed from the file deletion table 124, the cleanup thread 406 will not delete the myfile.7 file from the file system 118. This will ensure that the file system 118 stays synchronized with the object directory table 120.
  • a service provider 110 in accordance with the invention may be modified to implement the methods 200, 400 illustrated in Figures 2 and 4. Such a service provider 110 may include one or more modules to implement this
  • modules may be implemented in hardware, software or firmware executable on hardware, or a combination thereof.
  • these modules include one or more of an ID generator module 600, a storage module 602, an add-row module 604, a commit module 606, an add-to-directory module 608, a delete-row module 610, and a cleanup module 612.
  • ID generator module 600 an ID generator module 600
  • storage module 602 an add-row module 604
  • commit module 606 an add-to-directory module 608
  • delete-row module 610 a delete-row module 610
  • These modules are presented only by way of example and are not intended to be limiting. In certain embodiments, more or fewer modules than those illustrated may be provided. In other embodiments, the functionality from certain modules may be combined into fewer modules or, conversely, be divided into several modules.
  • an ID generator module 600 When the service provider 110 receives a request to store a named object, an ID generator module 600 generates a unique identifier for the named object in order to differentiate the instance of the object from other instances of the named object.
  • a storage module 602 then stores the named object as a uniquely named file in the file system 118. Once the file has been stored, an add-row module 604 inserts a "delete" entry into the file-deletion table 124 for the named object on the service thread 204.
  • a commit module 606 makes this entry permanent in the file-deletion table 124. This will make the deletion of the file the default action to be performed by the service provider 110.
  • an add-to-directory module 608 adds 216 an entry associated with the named object to the object directory table 120 on the application thread 202. This will indicate that the named object is stored in the file system 118.
  • a delete-row module 610 then deletes 218 the previously discussed "delete" entry from the file-deletion table 124 with the intent of eliminating the request to delete the named object. The permanence of this deletion will depend on the ultimate disposition of the transaction.
  • the application 102 is responsible for performing either a COMMIT or ROLLBACK to make permanent or reverse the work performed by the application 102.
  • a cleanup module 612 removes files from the file system 118 that have been identified for deletion in the file-deletion table 124.
  • a delay module 614 is configured to retrieve entries from the file-deletion table 124 that are older than some interval n.
  • a delete-file module 616 then deletes any files that are identified in the entries. This will synchronize the file system 1 18 with the object directory table 120.
  • a delete-row module 618 deletes the associated "delete" entry from the file-deletion table 124.
  • a commit module 620 then performs a COMMIT to make the change permanent in the file-deletion table 124.
  • a database table 124 may be used as a proxy to reverse a wide variety of actions when an application 102 ultimately disposes of a transaction, such as by performing a ROLLBACK.
  • a broader method 700 which encompasses the methods described in Figures 2 and 4, is illustrated in Figure 7.
  • an application 102 (operating under an application thread 702) initially transmits 708 a request to a service provider 110 to perform some action.
  • This action could include virtually anything, such as storing a file, executing a program, generating an object or artifact, performing a service, or the like.
  • the service provider 110 (operating under a separate service thread 704) generates 710 a unique identifier for this action in order to differentiate the action from other actions. The service provider 110 then performs 712 the action with the unique identifier.
  • the service provider 110 adds 714 an entry to an action-reversal table (similar to the file deletion table 124) for the action.
  • the service provider 110 then, on the service thread 204, performs 714 a COMMIT for this entry to make the entry permanent in the table. This will make the reversal of the action the default task to be performed by the service provider 110.
  • the service provider 110 then deletes 718 the entry from the action-reversal table, with the intent of eliminating the request to perform the action.
  • the permanence of this deletion will depend on the ultimate disposition of the transaction, and more specifically whether a COMMIT or ROLLBACK is ultimately executed by the application 102. If the application 102 eventually performs 720 a ROLLBACK, thereby reversing work performed by the application 102, the application 102 will roll back the deletion of the entry, thereby adding it back to the action-reversal table. Note that at this time the action will still have been performed and not reversed. Similarly, the service provider 110 will be unaware that the application 102 has disposed of the transaction by performing a ROLLBACK.
  • a cleanup thread 706 is executed by the service provider 110 at some future point in time.
  • the service provider 110 may initially retrieve 722 entries from the action-reversal table that are older than some interval n.
  • the interval n may be selected such as to allow the application 102 enough time to dispose of the transaction by performing either a COMMIT or a
  • the service provider 110 reverses 724 the action designated by the entry. Finally, the service provider 110 deletes 726 the entry from the action-reversal table requesting the reversal of the action. The service provider 110 then performs 726 a COMMIT to make this change permanent. In this way, any action falling outside an application's commit coordinator may be reversed.
  • each block in the flowcharts or block diagrams may represent a module, segment, or portion of code which comprises one or more executable instructions for implementing the specified logical function(s).
  • the functions noted in the block may occur out of the order noted in the Figures.
  • two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.
  • Other implementations may not require all of the disclosed steps to achieve the desired functionality.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

A system to synchronize a database and a non-database resource includes an application to transmit a request to a service provider to perform an action. The service provider receives the request and performs the action, the action not being under commit coordination. The service provider further inserts an entry into an action-reversal table to reverse the action and makes the insertion permanent. The service provider, on behalf of the application, then deletes the entry from the action-reversal table. The application may then be configured to perform one of the following: (1) make the delete permanent by performing a COMMIT; and (2) roll back the delete by performing a ROLLBACK. At a later time, the service provider may reverse the action in the event the entry remains in the action-reversal table. Corresponding methods and articles of manufacture (i.e., computer-readable media) are also disclosed herein.

Description

SYNCHRONIZING DATABASE AND NON-DATABASE RESOURCES
TECHNICAL FIELD
This invention relates to database and non-database resources, and more particularly to apparatus and methods for performing commit coordination for database and non-database resources.
BACKGROUND
A database transaction is a unit of work performed by a database management system (DBMS) or other application associated with a database. Transactions are generally performed using an "all-or-nothing" approach, meaning that all work units associated with a transaction must complete or none must complete. A "commit coordinator" built into a DBMS or application may ensure that a transaction completes in its entirety or not at all.
For example, consider a financial transaction where an application performs several steps using an "all-or-nothing" approach. In particular, the application transfers funds from a checking account to a savings account using the following steps (listed in pseudo code): begin transaction
debit checking account
credit savings account
update history log
commit transaction
All of the three steps must complete, or none must complete. Otherwise, data integrity will be lost. Because the steps within a transaction are processed as a whole, a transaction may be defined as an indivisible unit of work.
A transaction may terminate in one of two different ways, namely with a COMMIT or a ROLLBACK statement. When a transaction ends with a COMMIT statement (hereinafter referred to as a "COMMIT"), data modifications specified by the transaction are made permanent in the database. If, on the other hand, one or more data modifications in the transaction fail, a ROLLBACK statement (hereinafter referred to as a "ROLLBACK") may be used to undo the effects of all statements in the transaction. For example, if a disk drive were to crash during the "credit savings account" step listed above, a ROLLBACK statement could be executed in order to undo the data modifications made by the "debit checking account" statement. Although the transaction failed, data integrity would remain intact to keep the accounts balanced.
Unfortunately, an application may perform certain actions or cause certain actions to occur that fall outside of the application's normal "commit coordination." For example, consider an application that invokes, as part of a transaction, a service provider to perform some action, such as store a large image file in a file system. The service provider and file system may have no knowledge of the transaction. Thus, the actions performed by the service provider may fall outside the application's "commit coordination." In other words, the application may be unable to reverse actions performed by the service provider if the application ultimately performs a ROLLBACK. Likewise, the service provider may have no knowledge of the ROLLBACK and thus will also be unable to take actions to reverse the action. Using the above example, such a scenario may lead to orphaned files in the file system that were not reversed (i.e., deleted from the file system) in response to a
ROLLBACK.
In view of the foregoing, what is needed is an apparatus and method to reverse actions performed by a service provider or other entity acting outside an application's normal commit coordination. Such an apparatus and method would ideally be implemented without the need to modify the application and/or DBMS. Such an apparatus and method would also ideally leverage existing functionality in the application and/or DBMS.
SUMMARY
The invention has been developed in response to the present state of the art and, in particular, in response to the problems and needs in the art that have not yet been fully solved by currently available apparatus and methods. Accordingly, the invention has been developed to provide apparatus and methods for performing commit coordination for database and non-database resources.
Consistent with the foregoing, a system to synchronize a database and a non-database resource is disclosed herein. In certain embodiments, such a system includes an application to transmit a request to a service provider to store an object. The service provider receives the request and stores the object as a file, wherein the file is a non-database resource. The service provider further inserts an entry into a new file-deletion table to delete the file and makes the insertion permanent by performing a COMMIT. The service provider, on behalf of the application, is configured to delete the entry from the file-deletion table. The application may then perform one of the following: (1) make the delete permanent by performing a COMMIT; and (2) roll back the delete by performing a ROLLBACK. At a later time, the service provider is configured to delete the file in the event the entry remains in the file-deletion-table. In this way, a file system that is not under commit coordination may be synchronized with an application that is under commit coordination.
In another aspect of the invention, a system to synchronize a database and a non-database resource includes an application to transmit a request to a service provider to perform an action. The service provider receives the request and performs the action, the action not being under commit coordination. The service provider further inserts an entry into an action-reversal table to reverse the action and makes the insertion permanent by performing a COMMIT. The service provider, on behalf of the application, then deletes the entry from the action-reversal table. The application may then be configured to perform one of the following: (1) make the delete permanent by performing a COMMIT; and (2) roll back the delete by performing a ROLLBACK. At a later time, the service provider is configured to reverse the action in the event the entry remains in the action-reversal table.
Corresponding methods and articles of manufacture (i.e., computer-readable media) are also disclosed and claimed herein. BRIEF DESCRIPTION OF THE DRAWINGS
Embodiments of the invention will now be described, by way of example only, with reference to the accompany drawings in which:
Figure 1 is a high-level block diagram showing one example of an environment where an apparatus and method in accordance with the invention may operate;
Figure 2 is a flow diagram showing one embodiment of a method for synchronizing a database and a non-database resource when a ROLLBACK is performed;
Figure 3 shows the state of various data structures at different points in time when a ROLLBACK is performed;
Figure 4 is a flow diagram showing one embodiment of a method for synchronizing a database and a non-database resource when a COMMIT is performed;
Figure 5 shows the state of various data structures at different points in time when a COMMIT is performed;
Figure 6 is a high-level block diagram showing various modules that may be included in a service provider in accordance with the invention; and
Figure 7 is a flow diagram showing an alternative embodiment of a method for synchronizing a database and a non-database resource when a COMMIT and/or
ROLLBACK is performed.
DETAILED DESCRIPTION
It will be readily understood that the components of the present invention, as generally described and illustrated in the Figures herein, could be arranged and designed in a wide variety of different configurations. Thus, the following more detailed description of the embodiments of the invention, as represented in the Figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of certain examples of presently contemplated embodiments in accordance with the invention. The presently described embodiments will be best understood by reference to the drawings, wherein like parts are designated by like numerals throughout.
As will be appreciated by one skilled in the art, the present invention may be embodied as an apparatus, system, method, computer-readable medium, or computer program product. Furthermore, the present invention may take the form of a hardware embodiment, a software embodiment (including firmware, resident software, micro-code, etc.) configured to operate hardware, or an embodiment combining software and hardware aspects that may generally be referred to herein as a "module" or "system." Furthermore, the present invention may take the form of a computer program product embodied in any tangible medium of expression having computer-usable program code stored therein.
Any combination of one or more computer-usable or computer-readable medium(s) may be utilized to store the computer program product. The computer-usable or computer-readable medium may be, for example but not limited to, an electronic, magnetic, optical,
electromagnetic, infrared, or semiconductor system, apparatus, or device. More specific examples (a non-exhaustive list) of a computer-readable medium may include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CDROM), an optical storage device, or a magnetic storage device. In the context of this document, a computer-usable or computer-readable medium may be any medium that can contain, store, or transport a program for use by or in connection with the instruction execution system, apparatus, or device.
Computer program code for carrying out operations of the present invention may be written in any combination of one or more programming languages, including an object-oriented programming language such as Java, Smalltalk, C++, or the like, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on a user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).
Embodiments of the invention are described below with reference to flowchart illustrations and/or block diagrams of methods, apparatus, systems, computer-readable mediums, and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions or code. These computer program instructions may be provided to a processor of a general-purpose computer, special-purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable medium that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable medium produce an article of manufacture including instruction means which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. Referring to Figure 1, one example of an environment 100 where an apparatus and method in accordance with the invention may operate is illustrated. In this example, the
environment 100 includes an application 102 configured to access a database comprising one or more database tables 104. This database may be accessed by way of a database management system 106 (e.g., DB2 or analogous DBMS 106). In certain embodiments, the database tables 104 are stored on disk drives 108 or other suitable storage devices such as solid-state drives 108 (i.e., SSDs). The application 102 may be responsible for
synchronizing the database tables 104 to maintain data integrity and ensure that the data contained in the tables 104 is consistent. Thus, the application 102 may initiate "commit coordination" for data stored in the database tables 104.
In certain embodiments, the application 102 may communicate with a service provider 110 (such as "Object Access Method" (OAM) or other service provider) to provide one or more services. For example, the service provider 110 may enable the application 102 to store and retrieve "objects" in one or more storage devices, such as disk drives 112, optical drives 114, or tape drives 116. As an example, the service provider 110 may enable the application to store one or more objects as files in a file system 1 18. The application 102 may
communicate with the service provider 110 by way of an application programming interface 122 (such as the OSREQ API where the service provider is OAM).
An "object" may, in certain embodiments, include any named sequence of bytes. For example, an object could be image data (such as a compressed scanned image) or coded data. The service provider 110 may have no knowledge of the content, format, and/or structure of the sequence of bytes.
In certain embodiments, when the application 102 directs the service provider 110 to store an object in the storage devices 112, 114, 116, metadata for the object may be stored in a database table 104, such as an object directory table 120. This metadata may include information to locate and manage the object, among other information. When the application 102 stores the object (using the service provider API 122), the service provider 110 may add a row (i.e., entry) to the object directory table 120 containing metadata for the stored object. However, the application 102 and not the service provider 110 may perform the COMMIT for that row. If the application ultimately performs a ROLLBACK, this will delete the entry for the object from the object directory table 120 but may leave the object orphaned in the file system 1 18. In other words, because the file system 1 18 is not under the "commit coordination" of the DBMS 106, the object may continue to exist in the file system 1 18 even though the record for the object has been deleted from the object directory table
120. Furthermore, if the application 102 once again attempts to store the same specifically named object in the file system 1 18 (such as might occur in a "store-rollback-store" scenario), the store operation may fail because the named object already exists in the file system 1 18.
Accordingly, it would be an advance in the art to provide an apparatus and method to reverse actions performed by a service provider 1 10 or other entity acting outside an application's commit coordinator. It would be a further advance to provide such an apparatus and method without modifying the application 102 and/or DBMS 106. Such an apparatus and method would ideally leverage existing functionality in the application 102 and/or DBMS 106.
To provide these features, in selected embodiments, a file-deletion table 124 is provided to act as a proxy for a resource residing outside a DBMS's commit coordination. The file- deletion table 124 is under the DBMS's commit coordination and therefore be used to keep non-database resources synchronized and consistent with database resources. The function and operation of the file-deletion table 124 as well as other functionality will be described in more detail in association with Figures 2 through 5.
In the illustrated example, the application 102, DBMS 106, and service provider 1 10 run within the same host operating system 126 residing on a host system 128 (e.g., a mainframe computer or other computing system). However, the components 102, 106, 1 10 do not necessarily need to run on the same operating system 126 or host system 128. For example, the components 102, 106, 1 10 may operate in different operating systems 126 or run on different host systems 128. In certain embodiments, the components 102, 106, 1 10 may operate on different computers that communicate with each other over a network (e.g., a
LAN, WAN, the Internet, or the like). Thus, the illustrated hardware and software configuration is provided only by way of example and is not intended to be limiting. Referring to Figure 2, one embodiment of a method 200 for synchronizing a database and a non-database resource is illustrated. The method 200 of Figure 2 shows a scenario where an application 102 performs a ROLLBACK of the work it has performed. Figure 3 shows the states of various data structures at different points in time as the method 200 executes.
As illustrated in Figures 2 and 3, the application 102 (operating under an application thread 202) initially transmits 208 a request to a service provider 110 to store a named object. The service provider 110 (operating under a separate service thread 204) then generates 210 a unique identifier for the named object in order to differentiate the instance of the object from other instances of the named object. This differentiation may be important since the contents of an instance of a named object can be different from the contents of another instance of the same named object.
Operating under the service thread 204, the service provider 110 then stores 212 the named object as a file with a unique identifier in the file system 118. For example, as shown in Figure 3, at time Tl s an object named myfile with the unique identifier "7" is stored as my file.7 in the file system 118.
In anticipation that the application 102 may decide to roll back the request to store the named object, the service provider 110 adds 214 a "delete" entry to the file-deletion table 124 for the named object. The service provider may then perform 214 a COMMIT for this entry on the service thread 204 to make the entry permanent in the file-deletion table 124. For example, as shown at time T2, the service provider 110 inserts the entry delete myfile.7 into the file-deletion table (FDT) 124. In essence, this makes the deletion of the file the default action to be performed by the service provider 110.
Operating under the application thread 202, the service provider 110 then adds 216 the named object to the object directory table 120, thereby indicating that the named object is stored in the file system 118. As shown at time T3, the service provider 110 inserts metadata for the named object into the object directory table 120. The service provider 110 then deletes 218 the entry from the file-deletion table 124 with the intent of eliminating the request to delete the named object. For example, as shown at time T4, the service provider 110 removes the delete myfile.7 entry from the file-deletion table 124. The permanence of this deletion from the file-deletion table 124 will depend on the ultimate disposition of the transaction, and more specifically whether a COMMIT or
ROLLBACK is ultimately executed by the application 102.
In this example, the application 102 eventually performs 220 a ROLLBACK, thereby reversing the work performed by the application 102. This will roll back the deletion of the delete myfile.7 entry, thereby adding it back to the file-deletion table 124. Thus, as shown at time T5, the delete myfile.7 entry is restored to the file-deletion table 124 and the object's entry in the object directory table 120 is deleted. Note that the actual file remains in the file system 118. Further note that the service provider 110 is unaware that the application 102 has disposed of the transaction by performing a ROLLBACK.
In order to delete the file containing the named object from the file system 118, a cleanup thread 206 is executed by the service provider 110 at some future point in time. As shown, the service provider 110 initially retrieves entries from the file-deletion table 124 that are older than some interval n. The interval n may be selected such as to allow the application 102 enough time to dispose of the transaction (perform either a COMMIT or a
ROLLBACK). This interval n may be on the order of seconds, minutes, hours, days, or weeks, depending on the application 102.
Once an entry older than some interval n has been retrieved, the service provider 110 deletes the file specified by the entry in the file-deletion table 124. This will synchronize the file system 118 with the object directory table 120, where the entry for the named object was already deleted by the ROLLBACK 220. As shown in Figure 3, at time T6, the file myfile.7 is deleted from the file system 118. Finally, the service provider 110 deletes the entry from the file-deletion table 124 requesting the deletion of the named object. The service provider 110 performs a COMMIT for this change on the cleanup thread 206 to make it permanent. Thus, as shown at time T7, the delete myfile.7 entry is deleted from the file-deletion table 124.
Due to the unique identifier associated with each named object, the application 102 may continue to perform actions for the same named object, even if the previous instance of the named object has still not been deleted from the file system 118. For example, if the application 102 were to attempt to store the same named object again before the previous instance had been deleted, the service provider 110 would generate a new unique identifier for the new instance {e.g., my file.8). This instance could then be stored in the file system 118 without incurring an error due to a duplicate file name.
Referring to Figure 4, another embodiment of a method 400 for synchronizing a database and a non-database resource is illustrated. The method 400 of Figure 4 shows a scenario wherein the application 102 performs a COMMIT. Figure 5 shows the states of various data structures at different points in time as the method 400 is executed. The method 400 is the same as the method 200 illustrated in Figure 2 up until the time the application 102 performs 420 a COMMIT (instead of a ROLLBACK).
As shown in Figure 4, the application 102 performs 420 a COMMIT, thereby making work performed by the application 102 permanent. This will permanently delete the delete myfile.7 entry from the file-deletion table 124. Thus, as shown at time T5 in Figure 5, the delete myfile.7 entry is removed from the file-deletion table 124. The entry in the object directory table 120, however, is retained. Like the previous example, the service provider 110 is unaware that the application 102 has performed the COMMIT.
Like the previous example, a cleanup thread 406 is executed by the service provider 110 at some future point in time. Because the entry for the named object has been removed from the file deletion table 124, the cleanup thread 406 will not delete the myfile.7 file from the file system 118. This will ensure that the file system 118 stays synchronized with the object directory table 120. Referring to Figure 6, in certain embodiments, a service provider 110 in accordance with the invention may be modified to implement the methods 200, 400 illustrated in Figures 2 and 4. Such a service provider 110 may include one or more modules to implement this
functionality. These modules may be implemented in hardware, software or firmware executable on hardware, or a combination thereof. In selected embodiments, these modules include one or more of an ID generator module 600, a storage module 602, an add-row module 604, a commit module 606, an add-to-directory module 608, a delete-row module 610, and a cleanup module 612. These modules are presented only by way of example and are not intended to be limiting. In certain embodiments, more or fewer modules than those illustrated may be provided. In other embodiments, the functionality from certain modules may be combined into fewer modules or, conversely, be divided into several modules.
When the service provider 110 receives a request to store a named object, an ID generator module 600 generates a unique identifier for the named object in order to differentiate the instance of the object from other instances of the named object. A storage module 602 then stores the named object as a uniquely named file in the file system 118. Once the file has been stored, an add-row module 604 inserts a "delete" entry into the file-deletion table 124 for the named object on the service thread 204. A commit module 606 makes this entry permanent in the file-deletion table 124. This will make the deletion of the file the default action to be performed by the service provider 110.
Once the add-row module 604 has added a "delete" entry to the file-deletion table 124 and the entry has been committed, an add-to-directory module 608 adds 216 an entry associated with the named object to the object directory table 120 on the application thread 202. This will indicate that the named object is stored in the file system 118. A delete-row module 610 then deletes 218 the previously discussed "delete" entry from the file-deletion table 124 with the intent of eliminating the request to delete the named object. The permanence of this deletion will depend on the ultimate disposition of the transaction. At this point, the application 102 is responsible for performing either a COMMIT or ROLLBACK to make permanent or reverse the work performed by the application 102. At some future point in time, a cleanup module 612 removes files from the file system 118 that have been identified for deletion in the file-deletion table 124. For example, a delay module 614 is configured to retrieve entries from the file-deletion table 124 that are older than some interval n. A delete-file module 616 then deletes any files that are identified in the entries. This will synchronize the file system 1 18 with the object directory table 120.
Once a file has been deleted from the file system 1 18, a delete-row module 618 deletes the associated "delete" entry from the file-deletion table 124. A commit module 620 then performs a COMMIT to make the change permanent in the file-deletion table 124. Referring to Figure 7, although the apparatus and methods discussed herein have been discussed primarily in association with deleting files from a file system 118, the apparatus and methods discussed herein have much broader applicability. Indeed, deleting files from a file system 118 represents just one type of action that may be addressed by the apparatus and methods disclosed herein. In other embodiments, the apparatus and methods may be used to reverse a wide variety of actions that fall outside the normal "commit coordination" of an application 102 or DBMS 106. More specifically, a database table 124 may be used as a proxy to reverse a wide variety of actions when an application 102 ultimately disposes of a transaction, such as by performing a ROLLBACK. A broader method 700, which encompasses the methods described in Figures 2 and 4, is illustrated in Figure 7.
As illustrated in Figure 7, an application 102 (operating under an application thread 702) initially transmits 708 a request to a service provider 110 to perform some action. This action could include virtually anything, such as storing a file, executing a program, generating an object or artifact, performing a service, or the like. In certain embodiments, the service provider 110 (operating under a separate service thread 704) generates 710 a unique identifier for this action in order to differentiate the action from other actions. The service provider 110 then performs 712 the action with the unique identifier.
In anticipation that the application 102 may decide to roll back the request to perform the action, the service provider 110 adds 714 an entry to an action-reversal table (similar to the file deletion table 124) for the action. The service provider 110 then, on the service thread 204, performs 714 a COMMIT for this entry to make the entry permanent in the table. This will make the reversal of the action the default task to be performed by the service provider 110.
Operating under the application thread 702, the service provider 110 then deletes 718 the entry from the action-reversal table, with the intent of eliminating the request to perform the action. The permanence of this deletion will depend on the ultimate disposition of the transaction, and more specifically whether a COMMIT or ROLLBACK is ultimately executed by the application 102. If the application 102 eventually performs 720 a ROLLBACK, thereby reversing work performed by the application 102, the application 102 will roll back the deletion of the entry, thereby adding it back to the action-reversal table. Note that at this time the action will still have been performed and not reversed. Similarly, the service provider 110 will be unaware that the application 102 has disposed of the transaction by performing a ROLLBACK.
In order to reverse the action designated in the action-reversal table, a cleanup thread 706 is executed by the service provider 110 at some future point in time. As shown, the service provider 110 may initially retrieve 722 entries from the action-reversal table that are older than some interval n. The interval n may be selected such as to allow the application 102 enough time to dispose of the transaction by performing either a COMMIT or a
ROLLBACK. Once an entry older than some interval n has been retrieved, the service provider 110 reverses 724 the action designated by the entry. Finally, the service provider 110 deletes 726 the entry from the action-reversal table requesting the reversal of the action. The service provider 110 then performs 726 a COMMIT to make this change permanent. In this way, any action falling outside an application's commit coordinator may be reversed.
The flowcharts and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in the flowcharts or block diagrams may represent a module, segment, or portion of code which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the Figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. Other implementations may not require all of the disclosed steps to achieve the desired functionality. It will also be noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or fiowchart illustrations, may be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

Claims

1. A method to synchronize a database and a non-database resource, the method comprising:
transmitting a request to store an object;
receiving the request and storing the object as a file, wherein the file is a non- database resource;
inserting an entry into a file-deletion table to delete the file, and making the insertion permanent by performing a COMMIT;
deleting the entry from the file-deletion table; and
performing one of the following: (1) making the delete permanent by performing a COMMIT; and (2) rolling back the delete by performing a ROLLBACK.
2. The method of claim 1, further comprising deleting the file in the event the entry remains in the file-deletion-table.
3. The method of claim 2, wherein deleting the file further comprises waiting a period n before deciding to delete the file.
4. The method of claim 1, further comprising not deleting the file in the event the entry is permanently removed from the file-deletion-table.
5. The method of claim 4, wherein not deleting the file further comprises waiting a period n before deciding to not delete the file.
6. The method of claim 1, wherein storing the object as a file comprises storing the file in a file system.
7. The method of claim 1, further comprising generating a unique identifier and associating the file with the unique identifier.
8. The method of claim 7, wherein the entry identifies the file using the unique identifier.
9. A system to synchronize a database and a non-database resource, the system comprising an application and service provider adapted to perform the steps of any of claims 1 to 8.
10. A computer-readable medium having computer-usable program code embodied therein, the computer-usable program code when executed by a processor performing the steps of any of claims 1 to 8.
PCT/EP2010/065101 2009-10-31 2010-10-08 Synchronizing database and non-database resources WO2011051098A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
GB1201716.6A GB2487139A (en) 2009-10-31 2010-10-08 Synchronizing database and non-database resources
CN201080049531.XA CN102597995B (en) 2009-10-31 2010-10-08 Synchronizing database and non-database resources
DE112010004185.7T DE112010004185B4 (en) 2009-10-31 2010-10-08 Synchronize a database with non-database resources

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US12/610,281 US9020905B2 (en) 2009-10-31 2009-10-31 Synchronizing database and non-database resources without a commit coordinator
US12/610,281 2009-10-31

Publications (1)

Publication Number Publication Date
WO2011051098A1 true WO2011051098A1 (en) 2011-05-05

Family

ID=43770488

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2010/065101 WO2011051098A1 (en) 2009-10-31 2010-10-08 Synchronizing database and non-database resources

Country Status (5)

Country Link
US (1) US9020905B2 (en)
CN (1) CN102597995B (en)
DE (1) DE112010004185B4 (en)
GB (1) GB2487139A (en)
WO (1) WO2011051098A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105740131A (en) * 2014-12-09 2016-07-06 深圳中兴力维技术有限公司 Software user behavior backoff processing method and apparatus

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10048960B2 (en) * 2014-12-17 2018-08-14 Semmle Limited Identifying source code used to build executable files
WO2017058148A1 (en) * 2015-09-28 2017-04-06 Hewlett Packard Enterprise Development Lp Executing transactions based on success or failure of the transactions
CN107239467B (en) * 2016-03-29 2020-04-10 北京神州泰岳软件股份有限公司 Database-based data processing method and device
CN108073596B (en) * 2016-11-10 2020-08-14 北京国双科技有限公司 Data deletion method and device for OLAP database

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040030703A1 (en) * 2002-08-12 2004-02-12 International Business Machines Corporation Method, system, and program for merging log entries from multiple recovery log files
US20060253502A1 (en) * 2005-05-06 2006-11-09 Microsoft Corporation Maintenance of link level consistency between database and file system

Family Cites Families (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5297279A (en) * 1990-05-30 1994-03-22 Texas Instruments Incorporated System and method for database management supporting object-oriented programming
US6029160A (en) * 1995-05-24 2000-02-22 International Business Machines Corporation Method and means for linking a database system with a system for filing data
US6128771A (en) * 1996-02-09 2000-10-03 Sun Microsystems, Inc. System and method for automatically modifying database access methods to insert database object handling instructions
US5884327A (en) * 1996-09-25 1999-03-16 International Business Machines Corporation System, method and program for performing two-phase commit with a coordinator that performs no logging
US5765162A (en) * 1996-10-25 1998-06-09 International Business Machines Corporation Method for managing queryable datastore persistent objects and queryable datastore collections in an object-oriented environment
US5953719A (en) * 1997-09-15 1999-09-14 International Business Machines Corporation Heterogeneous database system with dynamic commit procedure control
US6453356B1 (en) * 1998-04-15 2002-09-17 Adc Telecommunications, Inc. Data exchange system and method
US6738971B2 (en) * 1999-03-10 2004-05-18 Oracle International Corporation Using a resource manager to coordinate the comitting of a distributed transaction
US10235368B2 (en) * 2000-06-08 2019-03-19 International Business Machines Corporation System and method for updating external file referenced by database with transactional consistency using SQL
US6571259B1 (en) * 2000-09-26 2003-05-27 Emc Corporation Preallocation of file system cache blocks in a data storage system
US6874001B2 (en) * 2001-10-05 2005-03-29 International Business Machines Corporation Method of maintaining data consistency in a loose transaction model
KR20030056540A (en) * 2001-12-28 2003-07-04 한국전자통신연구원 File destroy and recovery method against system failures in a database management system
US6873995B2 (en) * 2002-04-23 2005-03-29 International Business Machines Corporation Method, system, and program product for transaction management in a distributed content management application
US7412455B2 (en) * 2003-04-30 2008-08-12 Dillon David M Software framework that facilitates design and implementation of database applications
US7346905B2 (en) * 2003-06-10 2008-03-18 International Business Machines Corporation Apparatus and method for maintaining resource integrity without a unified transaction manager in a software environment
DE602004006224T2 (en) * 2004-03-18 2008-01-10 Alcatel Lucent Method and apparatus for data synchronization of a distributed database system
CN1725658A (en) * 2004-07-21 2006-01-25 中兴通讯股份有限公司 Real-time data base main standby synchronous method
US8271448B2 (en) * 2005-01-28 2012-09-18 Oracle International Corporation Method for strategizing protocol presumptions in two phase commit coordinator
US7478115B2 (en) * 2005-06-13 2009-01-13 Microsoft Corporation System and method for database and filesystem coordinated transactions
US7809777B2 (en) 2005-07-01 2010-10-05 Qnx Software Systems Gmbh & Co. Kg File system having deferred verification of data integrity
US8117605B2 (en) * 2005-12-19 2012-02-14 Oracle America, Inc. Method and apparatus for improving transactional memory interactions by tracking object visibility
US8880480B2 (en) * 2007-01-03 2014-11-04 Oracle International Corporation Method and apparatus for data rollback
US11281654B2 (en) * 2007-10-23 2022-03-22 International Business Machines Corporation Customized roll back strategy for databases in mixed workload environments
EP2330511B1 (en) * 2008-09-17 2016-07-20 Fujitsu Limited Data update synchronization method and system by two-phase commit
US9569254B2 (en) * 2009-07-28 2017-02-14 International Business Machines Corporation Automatic checkpointing and partial rollback in software transaction memory
US8356007B2 (en) * 2010-10-20 2013-01-15 Microsoft Corporation Distributed transaction management for database systems with multiversioning
US8825601B2 (en) * 2010-02-01 2014-09-02 Microsoft Corporation Logical data backup and rollback using incremental capture in a distributed database

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040030703A1 (en) * 2002-08-12 2004-02-12 International Business Machines Corporation Method, system, and program for merging log entries from multiple recovery log files
US20060253502A1 (en) * 2005-05-06 2006-11-09 Microsoft Corporation Maintenance of link level consistency between database and file system

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
ELMASRI R ET AL: "Fundamentals of Database Systems - PASSAGE", FUNDAMENTALS OF DATABASE SYSTEMS, XX, XX, 1 January 1994 (1994-01-01), pages 212 - 215,276, XP002270865 *
ELMASRI R ET AL: "Fundamentals of Database Systems - VALIDATION (OPTIMISTIC) CONCURRENCY CONTROL TECHNIQUES, RECOVERY CONCEPTS, CHECKPOINTS IN THE SYSTEM LOG AND FUZZY CHECKPOINTING", FUNDAMENTALS OF DATABASE SYSTEMS, ELMASRI R., NAVATHE S. B, BOSTON, MASS. [U.A.] : PEARSON, ADDISON-WESLEY, 1 January 2004 (2004-01-01), pages 551 - 635, XP002526530, ISBN: 978-0-321-20448-6 *
JUDITH R DAVIS: "Datalinks: Managing External Data with DB2 Universal Database", DATABASE TECHNOLOGY REPORTS OF DATABASE ASSOCIATES INTERNATIONAL, XX, XX, 1 August 1997 (1997-08-01), XP002474967 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105740131A (en) * 2014-12-09 2016-07-06 深圳中兴力维技术有限公司 Software user behavior backoff processing method and apparatus
CN105740131B (en) * 2014-12-09 2020-09-25 深圳力维智联技术有限公司 Software user behavior rollback processing method and device

Also Published As

Publication number Publication date
CN102597995B (en) 2015-02-18
DE112010004185T5 (en) 2012-08-30
CN102597995A (en) 2012-07-18
DE112010004185B4 (en) 2014-07-24
GB2487139A (en) 2012-07-11
GB201201716D0 (en) 2012-03-14
US20110106760A1 (en) 2011-05-05
US9020905B2 (en) 2015-04-28

Similar Documents

Publication Publication Date Title
US20210173746A1 (en) Backup and restore in a distributed database utilizing consistent database snapshots
US11455217B2 (en) Transaction consistency query support for replicated data from recovery log to external data stores
CN110447021B (en) Method, apparatus and system for maintaining consistency of metadata and data between data centers
US9146934B2 (en) Reduced disk space standby
US11625374B2 (en) Eventual consistency in a deduplicated cloud storage system
US10949415B2 (en) Logging system using persistent memory
US10430298B2 (en) Versatile in-memory database recovery using logical log records
JP4219589B2 (en) Transactional file system
US20160328488A1 (en) Structure linked native query database management system and methods
US8396833B2 (en) Inode management in redirect-on-write file system
CN104516943A (en) Archival management of database logs
EP3822794B1 (en) Data backup method and apparatus, server and computer readable storage medium
US20080005111A1 (en) Atomic transaction file manager
US7631159B1 (en) Faster recovery mechanism of validated continuous data protection (CDP) time image
US9020905B2 (en) Synchronizing database and non-database resources without a commit coordinator
WO2020192663A1 (en) Data management method and related device
CN115658391A (en) Backup recovery method of WAL mechanism based on QianBase MPP database
CN111026764B (en) Data storage method and device, electronic product and storage medium
US11200219B2 (en) System and method for idempotent metadata destage in a storage cluster with delta log based architecture
US7613710B2 (en) Suspending a result set and continuing from a suspended result set
US20170153951A1 (en) Incremental synchronous hierarchical system restoration
US11593338B2 (en) Computer-implemented method for database management, computer program product and database system
US20230195747A1 (en) Performant dropping of snapshots by linking converter streams
EP3391248A1 (en) Staging log-based page blobs on a filesystem

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 201080049531.X

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10763365

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 1201716

Country of ref document: GB

Kind code of ref document: A

Free format text: PCT FILING DATE = 20101008

WWE Wipo information: entry into national phase

Ref document number: 1201716.6

Country of ref document: GB

WWE Wipo information: entry into national phase

Ref document number: 112010004185

Country of ref document: DE

Ref document number: 1120100041857

Country of ref document: DE

122 Ep: pct application non-entry in european phase

Ref document number: 10763365

Country of ref document: EP

Kind code of ref document: A1