WO2013100415A1

WO2013100415A1 - Distributed data quality management system and method for same

Info

Publication number: WO2013100415A1
Application number: PCT/KR2012/010247
Authority: WO
Inventors: 국윤규; 이준; 박민우; 최기석; 김재수
Original assignee: 한국과학기술정보연구원
Priority date: 2011-12-28
Filing date: 2012-11-29
Publication date: 2013-07-04
Also published as: KR20130076062A

Abstract

The present invention relates to a distributed data quality management system and to a method for same. The distributed data quality management system includes: a slave operating device including a database for operating an autonomous legacy system and providing target data according to a data association request received from the outside; and a master operating device for transferring the data association request to one or more of the slave operating devices according to a specific process to collect the target data for associating with reference data, and for adjusting data values for the collected target data through the application of user-defined rules including at least any of variably set user-defined functions and embedded functions. According to the present invention, data quality can be enhanced by widely using data transformation and refinement, and changes in a legacy information system can be minimized.

Description

Distributed data quality management system and method

The present invention relates to a distributed data interoperability method, and more particularly, by performing data transformation and purification by dynamically generating and utilizing a business rule necessary for data transformation and purification based on user definition for interoperability of distributed data. In addition, the present invention relates to a distributed data quality management system and method for improving the quality of data.

In an environment where information system construction is common, it is important to use data to improve work productivity and efficiency.

In other words, the data management in the information system is very important because it supports business operation and decision-making through data analysis and processing, and especially, it must be managed so that invalid data is not utilized for work.

The quality of the data must be managed through cleanup or exclusion of invalid data, including error data. Therefore, valid and accurate data must be used for business purposes. It's important to manage your data so you can maintain it.

With the development of the IT environment, the construction of information systems has increased innumerably, and the interoperability of the loaded data is needed to improve work productivity and efficiency.

In other words, for interoperability of distributed data loaded in interspersed information systems, data reliability must be guaranteed in consideration of accuracy, redundancy, and consistency that can affect data quality. In particular, legacy information systems built as distributed environments Their data interoperability emphasizes the need for data quality control.

The present invention has been made in view of the above circumstances, and an object of the present invention is to generate and store a custom rule including at least one of a user-defined function and a built-in function in which the master operating apparatus is variably set. Requesting target data for linkage with reference data to a slave operating device operating each legacy system according to a specific process, and the slave operating device provides the target data stored in its own database according to the request. In this case, the master operating device provides a distributed data quality management system and method for performing data value adjustment on the collected target data for one or more of the slave operating devices through the application of the stored user-defined rule. Business rules for conversion and refining It is to perform data transformation and purification by dynamically generating and utilizing based on user definition.

Still another object of the present invention is to generate and store a custom rule including at least one of a variable and a user-defined function that is variablely set, and reference from one or more other operating devices that operate each legacy system. Collecting the target data for linkage with the data, and providing an operating device and an operation method for adjusting the data value for the collected target data through the application of the stored user-defined rules, necessary for data conversion and purification It is to perform data transformation and purification by dynamically creating and utilizing business rules based on user definition.

Distributed data quality management system according to the first aspect of the present invention for achieving the above object, the slave operating device having a database for operating its own legacy system, and provides the target data stored in the database in accordance with the data connection request ; And collecting the target data for linkage with reference data by transmitting the data linkage request to one or more slave operating devices according to a specific process, and selecting at least one of a user-defined function and a built-in function that are variably set. It characterized in that it comprises a master operating device for performing a data value adjustment for the collected target data through the application of a user-defined rule including.

Preferably, the master operating device sets the user defined function according to a user request through a user interface (UI), and performs error verification through grammar verification and execution verification of the set user defined function. The user-defined function of which error verification is completed is set as the user-defined rule and stored.

Preferably, the master operating device, characterized in that for setting the user-defined function in conjunction with the built-in function, in response to a user request through the user interface.

Preferably, the master operating device, by comparing the target data and the reference data through a predetermined heterogeneity determination criterion to determine the validity of the target data, if the determination result is not valid, the user It is characterized by adjusting a data value for the target data by applying a definition rule.

Preferably, the validity of the object data is determined through the heterogeneity determination criteria including at least one of structural heterogeneity, expression heterogeneity, relationship heterogeneity, and semantic heterogeneity.

Preferably, the master operating apparatus performs at least one of data type conversion, range limitation, expression mismatch adjustment, logic error adjustment, and meaningless adjustment through the application of the user-defined rule to the collected target data. And adjusting the data value for the data.

Operation apparatus according to a second aspect of the present invention for achieving the above object, a conversion rule setting unit for generating and storing a user-defined rule including at least one of a variable and a user-defined function is set variable; A data collector for collecting target data for linkage with reference data from one or more other operating apparatuses for operating each legacy system; And a conversion processor configured to apply the stored user definition rule to adjust data values of the collected target data.

Preferably, the conversion rule setting unit sets the user defined function according to a user request through a user interface (UI), and performs error verification through grammar verification and execution verification of the set user defined function. The user-defined function of which error verification is completed is set as the user-defined rule and stored.

Preferably, the conversion rule setting unit, according to the user request through the user interface, characterized in that for setting the user-defined function linked to the built-in function.

Preferably, the conversion processor determines the validity of the target data by performing comparison between the target data and the reference data through a predetermined heterogeneity determination criterion, and when the determination result is not valid, the user definition. The data value for the target data is adjusted by applying a rule.

Preferably, the conversion processing unit is characterized in that it determines the validity of the target data through the heterogeneity determination criteria including at least one of structural heterogeneity, expression heterogeneity, relationship heterogeneity, and semantic heterogeneity.

Preferably, the conversion processing unit performs at least one of data type conversion, range limitation, expression mismatch adjustment, logic error adjustment, and meaningless adjustment through the application of the user-defined rule to the collected target data. The data value adjustment is performed.

A distributed data quality management method according to a third aspect of the present invention for achieving the above object is provided: The method includes a custom rule including at least one of a user-defined function and a built-in function in which the master operating apparatus is variably set. A conversion rule setting step of generating and storing a message; A data request step of requesting, by the master operating device, target data for linkage with reference data, to a slave operating device operating each legacy system according to a specific process process; A target data providing step of providing, by the slave operating apparatus, the target data stored in its own database according to the request; And a data conversion processing step of performing, by the master operating device, data value adjustment on the collected target data to one or more of the slave operating devices through the application of the stored user defined rule.

Preferably, the conversion rule setting step includes: a function setting step of setting the user defined function according to a user request through a user interface (UI); An error verification step of performing error verification through grammar verification and execution verification of the set user defined function; And a function storage step of setting and storing the user-defined function whose error verification is completed as the user-defined rule.

Preferably, the function setting step, characterized in that for setting the user-defined function in conjunction with the built-in function, in response to a user request through the user interface.

Preferably, the data conversion processing step, the validity determination step of determining the validity of the target data by performing a comparison between the target data and the reference data through a predefined heterogeneity determination criteria; And a data adjustment step of adjusting a data value for the target data by applying the user definition rule when the determination result is not valid.

Preferably, the validity determining step is characterized by determining the validity of the target data through the heterogeneity determination criteria including at least one of structural heterogeneity, expression heterogeneity, relationship heterogeneity, and semantic heterogeneity.

Advantageously, the data adjustment step includes at least one of data type conversion, range limitation, expression mismatch adjustment, logic error adjustment, and meaningless adjustment through the application of the user-defined rule to the collected target data. And adjusting the data value for the data.

A method of operating an operating apparatus according to a third aspect of the present invention for achieving the above object comprises: a conversion rule setting step of generating and storing a user defined rule including at least one of a variable and a user defined function to be variable set; A data collection step of collecting target data for linkage with reference data from one or more other operating apparatuses that operate each legacy system; And a conversion processing step of performing data value adjustment on the collected target data by applying the stored user defined rule.

Preferably, the conversion processing step, the validity determination step of determining the validity of the target data by performing a comparison between the target data and the reference data through a predetermined heterogeneity determination criteria; And a data adjustment step of adjusting a data value for the target data by applying the user definition rule when the determination result is not valid.

According to a fifth aspect of the present invention, there is provided a computer-readable recording medium comprising: a conversion rule setting step of generating and storing a user-defined rule including at least one of a variable and a user-defined function; A data collection step of collecting target data for linkage with reference data from one or more other operating apparatuses that operate each legacy system; And instructions for executing a conversion processing step of performing data value adjustment on the collected target data by applying the stored user defined rule.

Preferably, the conversion rule setting step includes: a function setting step of setting the user defined function according to a user request through a user interface (UI); An error verification step of performing error verification through grammar verification and execution verification of the set user defined function; And a command for executing a function storing step of setting and storing the user-defined function whose error verification is completed as the user-defined rule.

Preferably, the conversion processing step, the validity determination step of determining the validity of the target data by performing a comparison between the target data and the reference data through a predetermined heterogeneity determination criteria; And a command for executing a data adjusting step of adjusting a data value for the target data by applying the user-defined rule when the determination result is not valid.

Therefore, according to the distributed data quality management system and method according to the present invention, by dynamically generating and utilizing a business rule necessary for data conversion and purification for user-based basis for the interoperability of distributed data, it is widely used for data conversion and purification Use it to improve the quality of data and further minimize changes in legacy information systems.

1 is a schematic configuration diagram of a distributed data quality management system according to an embodiment of the present invention.

2 is a schematic configuration diagram of an operation apparatus according to an embodiment of the present invention.

3 is a view for explaining a user interface according to an embodiment of the present invention.

4 is a view for explaining a user-defined function according to an embodiment of the present invention.

5 is a diagram for explaining an example of data value adjustment according to an embodiment of the present invention;

6 is a schematic flowchart illustrating an operating method of a distributed data quality management system according to an embodiment of the present invention.

7 is a schematic flowchart illustrating a method of operating an operating apparatus according to an embodiment of the present invention.

Hereinafter, with reference to the accompanying drawings will be described a preferred embodiment of the present invention.

1 is a schematic structural diagram of a distributed data quality management system according to an embodiment of the present invention.

As shown in FIG. 1, the system collects target data for linkage with reference data to one or more slave operating apparatuses 200 operating each legacy system and performs data value adjustment. Device 100; And a slave device 200 for providing target data according to a data linkage request from the master operating device 100. Here, in the case of the master operating device 100 and the slave operating device 200, refers to a server operating each legacy system on the same domain or different domains, a process that requires distributed data collection It has the same configuration that the agent (Agent) for processing, but may be divided into a master operating device 100 or a slave operating device 200 according to the process processing subject. Thus, in the following description, it is assumed that the operating device for collecting distributed data in accordance with the process processing through the agent as a master operating device 100, and at the same time provides the target data itself stored in accordance with the request of the master operating device 200 It is assumed that the operating device to be a slave operating device 200 will be described.

The master operating apparatus 100 generates and stores a user-defined rule for adjusting data values.

More specifically, the master operation apparatus 100 sets the user definition function according to a user request through a user interface (UI). That is, the master operation apparatus 100 provides a user interface as shown in FIG. 3, and sets a user defined function according to a user request through the provided user interface. In the case of the user-defined function, as shown in FIG. 4, for example, a function type for distinguishing a business rule, a function name, a parameter included in the function, a data type for returning a function execution result value, and a description of the function. , Function usage and function contents, which are algorithms that are actually performed in the function, may be included, and the function contents may be written in JavaScript and executed by a JavaScript execution engine, without compiling or re-executing for use in a data conversion system. Make it available during execution. On the other hand, the user-defined function may be set to work with the built-in function, in response to a user request through the provided user interface. Here, the built-in function refers to a function provided by the system itself, and may include, for example, a date / time function, a math / triangle function, a statistical function, a logical function, and the like. In addition, the master operation apparatus 100 performs error verification on the user defined function set through the user interface. In other words, the master operation apparatus 100 performs a grammatical verification of the user-defined function, converts a variable to be used in, for example, Javascript, and verifies the error of the function through testing therefor. Furthermore, the master operating apparatus 100 sets and stores the user defined function in which error verification is completed, as the user defined rule. That is, the master operating apparatus 100 stores a user-defined function that has completed error verification through grammar verification and execution verification as a user-defined rule. Then, the stored user-defined rule is called when a data conversion and purification is required. To be applied.

In addition, the master operating device 100 requests and collects target data for linkage with reference data to one or more slave operating devices 200.

More specifically, the master operating apparatus 100 transmits a data linkage request to one or more slave operating apparatuses 200 operating each legacy system according to a specific process processing according to an agent driving, thereby linking with reference data. Collect the target data for. In this regard, the slave operation apparatus 100 supports the process processing operation of the master operation apparatus 100 by extracting and providing self-stored target data when a data linkage request is received from the master operation apparatus 100. .

In addition, the master operation apparatus 100 performs data value adjustment on the collected target data through the application of the stored user defined rule.

More specifically, the master operating device 100 determines the validity of the target data collected from at least one slave operating device 200. That is, the master operation apparatus 100 compares the target data with the reference data based on predefined heterogeneity determination criteria such as structural heterogeneity, expression heterogeneity, relationship heterogeneity, and semantic heterogeneity, thereby validating the target data. To judge. Further, when the determination result is not valid, the master operation apparatus 100 applies the user definition rule to adjust the data value for the target data. That is, when it is determined that the validity of the target data is not valid, the master operating apparatus 100 calls a stored user defined rule, for example, data type conversion, range limitation, expression mismatch adjustment, logic error adjustment, and meaningless adjustment. By adjusting the data value for the target data, the target data is converted into valid data for linking with the reference data. For example, as shown in FIG. 5, when the data 'Korea' of the operating device 1 and the data 'KOR' of the operating device 2 are linked, the data 'Korea' of the operating device 1 and the data 'KOR' of the operating device 2 Although different by natural language processing, they are semantically the same. In this case, by calling and applying the user-defined rules generated through the above-described process, when the 'Korea' of the operating device 1 is linked to the operating device 2, the conversion and purification is carried out to 'KOR', the 'KOR' of the operating device 2 'Is converted to' Korea 'and refined when linked to the operating device 1.

Hereinafter, with reference to Figure 2, it will be described a specific configuration of the master operating device 100 according to an embodiment of the present invention.

That is, as shown in FIG. 2, the master operation apparatus 100 includes a conversion rule setting unit 110 for generating and storing a user-defined rule, and a data collecting unit 120 for collecting target data for linkage with reference data. , And a conversion processing unit 130 for applying a user-defined rule to perform data value adjustment for the collected target data.

The conversion rule setting unit 110 sets the user defined function according to a user request through a user interface (UI).

More specifically, the conversion rule setting unit 110 provides a user interface as shown in FIG. 3, and sets a user defined function according to a user request through the provided user interface. In the case of the user-defined function, as shown in FIG. 4, for example, a function type for distinguishing a business rule, a function name, a parameter included in the function, a data type for returning a function execution result value, and a description of the function. , Function usage and function contents, which are algorithms that are actually performed in the function, may be included, and the function contents may be written in JavaScript and executed by a JavaScript execution engine, without compiling or re-executing for use in a data conversion system. Make it available during execution. On the other hand, the user-defined function may be set to work with the built-in function, in response to a user request through the provided user interface. Here, the built-in function refers to a function provided by the system itself, and may include, for example, a date / time function, a math / triangle function, a statistical function, a logical function, and the like.

In addition, the conversion rule setting unit 110 performs error verification on the user defined function set through the user interface.

More specifically, the conversion rule setting unit 110 performs a grammatical verification of the user-defined function, converts a variable to be used in, for example, Javascript, and verifies the error of the function by testing the same. .

Further, the conversion rule setting unit 110 sets and stores the user defined function in which error verification is completed as the user defined rule.

More specifically, the conversion rule setting unit 110 stores a user-defined function that has completed error verification through grammar verification and execution verification as a user-defined rule, and then stores the user-defined rule at the time when data conversion and purification are required. To be called and applied.

The data collector 120 requests and collects target data for linkage with reference data to one or more slave operating apparatuses 200.

More specifically, the data collection unit 120 transfers a data connection request to one or more slave operating apparatuses 200 operating each legacy system according to a specific process processing according to an agent driving, thereby linking with reference data. Collect the target data for.

The conversion processor 130 determines the validity of the target data collected from at least one slave operating apparatus 200.

More specifically, the conversion processor 130 performs a comparison between the target data and the reference data based on predefined heterogeneity determination criteria such as structural heterogeneity, expression heterogeneity, relationship heterogeneity, and semantic heterogeneity. Determine the validity.

Further, when the determination result is not valid, the conversion processor 130 adjusts the data value for the target data by applying the user definition rule.

More specifically, when it is determined that the validity of the target data is not valid, the conversion processing unit 130 calls a stored custom rule, for example, data type conversion, range limitation, expression mismatch adjustment, logic error adjustment, and meaningless adjustment. By adjusting the data value for the target data by performing such a method, the target data is converted into valid data for linking with the reference data. For example, as shown in FIG. 5, when the data 'Korea' of the operating device 1 and the data 'KOR' of the operating device 2 are linked, the data 'Korea' of the operating device 1 and the data 'KOR' of the operating device 2 Although different by natural language processing, they are semantically the same. In this case, by calling and applying the user-defined rules generated through the above-described process, when the 'Korea' of the operating device 1 is linked to the operating device 2, the conversion and purification is carried out to 'KOR', the 'KOR' of the operating device 2 'Is converted to' Korea 'and refined when linked to the operating device 1.

As described above, according to the distributed data quality management system according to the present invention, by dynamically generating and utilizing a business rule required for data conversion and purification for user interaction based on the user definition for distributed data interoperability, It can be used extensively to improve the quality of data and further minimize changes in legacy information systems.

Hereinafter, a distributed data quality management method according to an embodiment of the present invention will be described with reference to FIGS. 6 and 7. Here, the above-described configuration shown in Figures 1 to 5 will be described by referring to the corresponding reference numerals for convenience of description.

First, an operation method of a distributed data quality management system according to an embodiment of the present invention will be described with reference to FIG. 6.

First, the master operating apparatus 100 generates and stores a user-defined rule for adjusting data values (S110-S120).

Preferably, the master operation apparatus 100 sets the user definition function according to a user request through a user interface (UI). That is, the master operation apparatus 100 provides a user interface as shown in FIG. 3, and sets a user defined function according to a user request through the provided user interface. In the case of the user-defined function, as shown in FIG. 4, for example, a function type for distinguishing a business rule, a function name, a parameter included in the function, a data type for returning a function execution result value, and a description of the function. , Function usage and function contents, which are algorithms that are actually performed in the function, may be included, and the function contents may be written in JavaScript and executed by a JavaScript execution engine, without compiling or re-executing for use in a data conversion system. Make it available during execution. On the other hand, the user-defined function may be set to work with the built-in function, in response to a user request through the provided user interface. Here, the built-in function refers to a function provided by the system itself, and may include, for example, a date / time function, a math / triangle function, a statistical function, a logical function, and the like. In addition, the master operation apparatus 100 performs error verification on the user defined function set through the user interface. In other words, the master operation apparatus 100 performs a grammatical verification of the user-defined function, converts a variable to be used in, for example, Javascript, and verifies the error of the function through testing therefor. Furthermore, the master operating apparatus 100 sets and stores the user defined function in which error verification is completed, as the user defined rule. That is, the master operating apparatus 100 stores a user-defined function that has completed error verification through grammar verification and execution verification as a user-defined rule. Then, the stored user-defined rule is called when a data conversion and purification is required. To be applied.

Then, the master operating apparatus 100 requests and collects target data for linkage with reference data to one or more slave operating apparatuses 200 (S130-S160).

Preferably, the master operating apparatus 100 transmits a data linkage request to one or more slave operating apparatuses 200 operating each legacy system according to a specific process processing according to the agent driving, thereby linking with the reference data. Collect the target data for. In this regard, the slave operation apparatus 100 supports the process processing operation of the master operation apparatus 100 by extracting and providing self-stored target data when a data linkage request is received from the master operation apparatus 100. .

Thereafter, the master operating apparatus 100 performs data value adjustment on the collected target data through the application of the stored user defined rules (S170-S190).

Preferably, the master operating device 100 determines the validity of the target data collected from one or more of the slave operating device 200. That is, the master operation apparatus 100 compares the target data with the reference data based on predefined heterogeneity determination criteria such as structural heterogeneity, expression heterogeneity, relationship heterogeneity, and semantic heterogeneity, thereby validating the target data. To judge. Further, when the determination result is not valid, the master operation apparatus 100 applies the user definition rule to adjust the data value for the target data. That is, when it is determined that the validity of the target data is not valid, the master operating apparatus 100 calls a stored user defined rule, for example, data type conversion, range limitation, expression mismatch adjustment, logic error adjustment, and meaningless adjustment. By adjusting the data value for the target data, the target data is converted into valid data for linking with the reference data. For example, as shown in FIG. 5, when the data 'Korea' of the operating device 1 and the data 'KOR' of the operating device 2 are linked, the data 'Korea' of the operating device 1 and the data 'KOR' of the operating device 2 Although different by natural language processing, they are semantically the same. In this case, by calling and applying the user-defined rules generated through the above-described process, when the 'Korea' of the operating device 1 is linked to the operating device 2, the conversion and purification is carried out to 'KOR', the 'KOR' of the operating device 2 'Is converted to' Korea 'and refined when linked to the operating device 1.

Next, an operation method of the master operation apparatus 100 according to the embodiment of the present invention will be described with reference to FIG. 7.

First, the user defined function is set according to a user request through a user interface (UI) (S210-S220).

Preferably, the conversion rule setting unit 110 provides a user interface as shown in FIG. 3, and sets a user defined function according to a user request through the provided user interface. In the case of the user-defined function, as shown in FIG. 4, for example, a function type for distinguishing a business rule, a function name, a parameter included in the function, a data type for returning a function execution result value, and a description of the function. , Function usage and function contents, which are algorithms that are actually performed in the function, may be included, and the function contents may be written in JavaScript and executed by a JavaScript execution engine, without compiling or re-executing for use in a data conversion system. Make it available during execution. On the other hand, the user-defined function may be set to work with the built-in function, in response to a user request through the provided user interface. Here, the built-in function refers to a function provided by the system itself, and may include, for example, a date / time function, a math / triangle function, a statistical function, a logical function, and the like.

Then, error verification for the user-defined function set through the user interface is performed (S230).

Preferably, the conversion rule setting unit 110 performs a grammatical verification of the user-defined function, and converts a variable so that it can be used in, for example, JavaScript, and verifies the error of the function through testing therefor. .

Thereafter, the user-defined function in which error verification is completed is set as the user-defined rule and stored (S240).

Preferably, the conversion rule setting unit 110 stores a user-defined function that has completed error verification through grammar verification and execution verification as a user-defined rule, and then stores the user-defined rule at the time when data conversion and purification are required. To be called and applied.

Next, the target data for linkage with the reference data is collected and collected at one or more slave operating apparatuses 200 (S250).

Preferably, the data collection unit 120 transfers a data connection request to one or more slave operating apparatuses 200 operating each legacy system according to a specific process processing according to the agent driving, thereby linking with the reference data. Collect the target data for.

Then, the validity of the target data collected from the one or more slave operating apparatus 200 is determined (S260).

Preferably, the conversion processor 130 compares the target data with the reference data based on a predetermined heterogeneity determination criterion, for example, structural heterogeneity, expression heterogeneity, relationship heterogeneity, and semantic heterogeneity. Determine the validity.

Thereafter, if the determination result is not valid, the data value for the target data is adjusted by applying the user-defined rule (S270-S290).

Preferably, when it is determined that the validity of the target data is not valid, the conversion processing unit 130 calls a stored user defined rule, for example, data type conversion, range limitation, expression mismatch adjustment, logic error adjustment, and meaningless adjustment. By adjusting the data value for the target data by performing such a method, the target data is converted into valid data for linking with the reference data. For example, as shown in FIG. 5, when the data 'Korea' of the operating device 1 and the data 'KOR' of the operating device 2 are linked, the data 'Korea' of the operating device 1 and the data 'KOR' of the operating device 2 Although different by natural language processing, they are semantically the same. In this case, by calling and applying the user-defined rules generated through the above-described process, when the 'Korea' of the operating device 1 is linked to the operating device 2, the conversion and purification is carried out to 'KOR', the 'KOR' of the operating device 2 'Is converted to' Korea 'and refined when linked to the operating device 1.

As described above, according to the distributed data quality management method according to the present invention, by dynamically generating and utilizing a business rule necessary for data conversion and purification for user interaction based on the user definition for distributed data interoperability, It can be used extensively to improve the quality of data and further minimize changes in legacy information systems.

Meanwhile, the steps of the method or algorithm described in connection with the embodiments presented herein may be embodied in the form of program instructions that may be executed by various computer means and recorded on a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. Program instructions recorded on the media may be those specially designed and constructed for the purposes of the present invention, or they may be of the kind well-known and available to those having skill in the computer software arts. Examples of computer readable recording media include magnetic media such as hard disks, floppy disks and magnetic tape, optical media such as CD-ROMs, DVDs, and magnetic disks such as floppy disks. Magneto-optical media, and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like. The hardware device described above may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

Although the present invention has been described in detail with reference to preferred embodiments, the present invention is not limited to the above-described embodiments, and the present invention belongs to the present invention without departing from the gist of the present invention as claimed in the following claims. Anyone skilled in the art will have the technical idea of the present invention to the extent that various modifications or changes are possible.

According to the distributed data quality management system and method thereof according to the present invention, it overcomes the limitations of the existing technology in that it dynamically generates and utilizes business rules necessary for data transformation and purification for user interaction based on interoperability of distributed data. According to the present invention, there is not only the use of the related technology but also the possibility of marketing or sales of the applied device as well as the degree to which it can be clearly realized in reality.

Claims

A slave operating apparatus having a database for operating its own legacy system and providing target data stored in the database according to a data linkage request; And

The data linkage request is delivered to one or more slave operating devices according to a specific process to collect the target data for linkage with reference data, and includes at least one of a user-defined function and a built-in function that are variably set. And a master operating device configured to perform data value adjustment on the collected target data by applying a user-defined rule.
The method of claim 1,

The master operating device,

Set the user defined function in response to a user request through a user interface (UI),

Error verification is performed through grammar verification and execution verification of the set user-defined function,

Distributed data quality management system, characterized in that for storing the user-defined function, the error verification is completed by setting the user-defined rule.
The method of claim 2,

The master operating device,

Distributed data quality management system according to the user request through the user interface, characterized in that for setting the user-defined function linked to the built-in function.
The method of claim 1,

The master operating device,

Determining the validity of the target data by performing a comparison between the target data and the reference data through a predefined heterogeneity determination criteria,

If the determination result is not valid, the distributed data quality management system, characterized in that for adjusting the data value for the target data by applying the user-defined rules.
The method of claim 4, wherein

The master operating device,

And a validity of the target data is determined through the heterogeneity determination criteria including at least one of structural heterogeneity, expression heterogeneity, relationship heterogeneity, and semantic heterogeneity.
The method of claim 4, wherein

The master operating device,

Through the application of the user-defined rule, at least one of data type conversion, range limitation, expression mismatch adjustment, logic error adjustment, and meaningless adjustment is performed to perform the data value adjustment on the collected target data. Distributed data quality management system.
A conversion rule setting unit for generating and storing a user-defined rule including at least one of a user-defined function and a built-in function that are variably set;

A data collector for collecting target data for linkage with reference data from one or more other operating apparatuses for operating each legacy system; And

And a conversion processor configured to apply the stored user definition rule to adjust data values of the collected target data.
The method of claim 7, wherein

The conversion rule setting unit,

Set the user defined function in response to a user request through a user interface (UI),

Error verification is performed through grammar verification and execution verification of the set user-defined function,

Operating apparatus, characterized in that for storing the user-defined function, the error verification is completed by setting the user-defined rule.
The method of claim 8,

The conversion rule setting unit,

And operating the user-defined function linked to the built-in function according to a user request through the user interface.
The method of claim 7, wherein

The conversion processing unit,

Determining the validity of the target data by performing a comparison between the target data and the reference data through a predefined heterogeneity determination criteria,

And when the determination result is not valid, adjusting the data value for the target data by applying the user-defined rule.
The method of claim 10,

The conversion processing unit,

And determining validity of the target data through the heterogeneity determination criteria including at least one of structural heterogeneity, expression heterogeneity, relationship heterogeneity, and semantic heterogeneity.
The method of claim 10,

The conversion processing unit,

Through the application of the user-defined rule, at least one of data type conversion, range limitation, expression mismatch adjustment, logic error adjustment, and meaningless adjustment is performed to perform the data value adjustment on the collected target data. Operating device.
A conversion rule setting step of generating and storing a user-defined rule including at least one of a user-defined function and a built-in function of which the master operating apparatus is set variable;

A data request step of requesting, by the master operating device, target data for linkage with reference data, to a slave operating device operating each legacy system according to a specific process process;

A target data providing step of providing, by the slave operating apparatus, the target data stored in its own database according to the request; And

Distributed data quality management, characterized in that the master operating device performs a data value adjustment for the target data collected for one or more of the slave operating device through the application of the stored user-defined rules. Way.
The method of claim 13,

The conversion rule setting step,

A function setting step of setting the user defined function according to a user request through a user interface (UI);

An error verification step of performing error verification through grammar verification and execution verification of the set user defined function; And

And a function storing step of setting and storing the user-defined function whose error verification is completed as the user-defined rule.
The method of claim 14,

The function setting step,

And setting the user defined function linked with the embedded function according to a user request through the user interface.
The method of claim 13,

The data conversion processing step,

A validity determination step of determining a validity of the target data by performing a comparison between the target data and the reference data through a predefined heterogeneity determination criterion; And

And a data adjustment step of adjusting a data value for the target data by applying the user-defined rule when the determination result is not valid.
The method of claim 16,

The validity judgment step,

And determining validity of the target data through the heterogeneity determination criteria including at least one of structural heterogeneity, expression heterogeneity, relationship heterogeneity, and semantic heterogeneity.
The method of claim 16,

The data adjustment step,

Through the application of the custom rule, at least one of data type conversion, range limitation, expression mismatch adjustment, logic error adjustment, and meaningless adjustment is performed to perform the data value adjustment on the collected target data. Distributed data quality management.
A conversion rule setting step of generating and storing a user-defined rule including at least one of a variable and a user-defined function that are set variable;

A data collection step of collecting target data for linkage with reference data from one or more other operating apparatuses that operate each legacy system; And

And a conversion processing step of performing data value adjustment on the collected target data by applying the stored user defined rule.
The method of claim 19,

The conversion rule setting step,

A function setting step of setting the user defined function according to a user request through a user interface (UI);

An error verification step of performing error verification through grammar verification and execution verification of the set user defined function; And

And a function storing step of setting and storing the user-defined function whose error verification is completed as the user-defined rule.
The method of claim 20,

The function setting step,

And operating the user-defined function linked to the embedded function according to a user request through the user interface.
The method of claim 19,

The conversion processing step,

A validity determination step of determining a validity of the target data by performing a comparison between the target data and the reference data through a predefined heterogeneity determination criterion; And

And a data adjustment step of adjusting a data value for the target data by applying the user definition rule when the determination result is not valid.
The method of claim 22,

The validity judgment step,

And determining validity of the target data through the heterogeneity determination criteria including at least one of structural heterogeneity, expression heterogeneity, relationship heterogeneity, and semantic heterogeneity.
The method of claim 22,

The data adjustment step,

Through the application of the custom rule, at least one of data type conversion, range limitation, expression mismatch adjustment, logic error adjustment, and meaningless adjustment is performed to perform the data value adjustment on the collected target data. Operation method of the operating device.
A conversion rule setting step of generating and storing a user-defined rule including at least one of a variable and a user-defined function that are set variable;

A data collection step of collecting target data for linkage with reference data from one or more other operating apparatuses that operate each legacy system; And

And instructions for executing a conversion processing step of performing data value adjustment on the collected target data by applying the stored user defined rule.
The method of claim 25,

The conversion rule setting step,

A function setting step of setting the user defined function according to a user request through a user interface (UI);

An error verification step of performing error verification through grammar verification and execution verification of the set user defined function; And

And a command for executing a function storing step of setting and storing the user-defined function whose error verification is completed as the user-defined rule.
The method of claim 26,

The function setting step,

And setting the user defined function linked with the embedded function according to a user request through the user interface.
The method of claim 25,

The conversion processing step,

A validity determination step of determining a validity of the target data by performing a comparison between the target data and the reference data through a predefined heterogeneity determination criterion; And

And a command for executing a data adjusting step of adjusting a data value for the target data by applying the user-defined rule when the determination result is not valid.
The method of claim 28,

The validity judgment step,

And determining the validity of the object data through the heterogeneity determination criteria including at least one of structural heterogeneity, expression heterogeneity, relationship heterogeneity, and semantic heterogeneity.
The method of claim 28,

The data adjustment step,

Through the application of the user-defined rule, at least one of data type conversion, range limitation, expression mismatch adjustment, logic error adjustment, and meaningless adjustment is performed to perform the data value adjustment on the collected target data. A computer readable recording medium.