CN102638584A - Data distributing and caching method and data distributing and caching system - Google Patents
Data distributing and caching method and data distributing and caching system Download PDFInfo
- Publication number
- CN102638584A CN102638584A CN2012101182277A CN201210118227A CN102638584A CN 102638584 A CN102638584 A CN 102638584A CN 2012101182277 A CN2012101182277 A CN 2012101182277A CN 201210118227 A CN201210118227 A CN 201210118227A CN 102638584 A CN102638584 A CN 102638584A
- Authority
- CN
- China
- Prior art keywords
- data
- node
- distributed
- module
- distribution
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
The invention relates to the technical field of data management, and provides a data distributing and caching method and a data distributing and caching system. The method comprises the following steps of: during the generation of business data or change of business data, increasing node ID (identification) information for each datum according to a preset allocation strategy, and storing the data in a center database; extracting the business data in the center database, and according the node ID information carried by each datum, distributing the data to corresponding node servers; extracting the data distributed to the node from the node server, and synchronizing to the cache of the node; and accessing each user group into a special node, so that a user can access the business data through the node in a caching way. According to the invention, the data with the same category attribution are divided into one group, and according to a distributing process, the business data with the same attribution are distributed to the cache which is accessed by the user recently, and are provided to the business operators, so that the internal memory occupancy of the cache data to the center database can be reduced, and the access speed of the data can be improved.
Description
Technical field
The present invention relates to the data management technique field, particularly a kind of data distributed buffer method and system.
Background technology
At present; At NGB (Next Generation Broadcasting network; Broadcasting and television network of future generation) in the field; The broadcast system of radio and television is separate in each area, and generally, each territory, local administrative area all can be set up the relatively independent system of a cover and support local broadcast television service.
And under province's planar network architecture of upper level,, realize professional the interconnecting and merge of broadcasting and TV in order to satisfy provincial broadcasting and TV system to the professional unified management of broadcasting and TV inside the province, need to each independently system integrate, use unified business management system.For the business of broadcasting and TV, concentrate the pressure that needs the dispersion user data access after disposing, so need to realize the function of distributed caching.
In the implementation of prior art, generally adopt the unified data storehouse to manage, promptly be stored in all users or business datum in the unified data storehouse, professional directly accessing database, data query is realized representing of business datum.After business datum reaches certain scale; High to power system capacity and performance requirement; For avoiding the limited visit bottleneck that causes of throughput of system, can further be stored in the different service data respectively usually and improve power system capacity and performance in the different databases according to type of service.After the scale of single business datum also acquires a certain degree, can vertically split business datum, be distributed to business datum in a plurality of different databases, the professional different database of request back visit that receives obtains data.
Yet in realizing process of the present invention, the inventor finds; Business datum is only divided according to type of service in the prior art; The user need be according to the different database of different access of request, because it is far away to economize most users' under the planar network architecture actual access distance when visit data; Only can't guarantee user capture speed, so it is low relatively to economize under the planar network architecture the professional access efficiency of broadcasting and TV in the prior art according to the type of service dividing data.
Summary of the invention
The technical problem that (one) will solve
To the shortcoming of prior art, the present invention has proposed a kind of data distributed buffer method and system in order to solve the low problem of access efficiency in the prior art, has effectively reduced data cachedly to the taking of central database internal memory, and has improved data access speed.
(2) technical scheme
To achieve these goals, on the one hand, the invention provides a kind of data distributed buffer method, said method comprises step:
S1 when generating business datum or business datum and change, increases node ID information according to predefined collocation strategy to each data, with storage in central database;
S2 carries out the data distribution, the business datum in the central database taken out, and the node ID information entrained according to each data, data are distributed to the corresponding nodes server;
S3 takes out the data that are distributed to this node from node server, be synchronized in the buffer memory of this node;
S4 is linked into a specific node with each customer group, and the user is through these nodal cache access service data.
Preferably, the whole business datums of storage and uniform in the said central database.
Preferably, among the step S1, said collocation strategy comprises:
When carrying out the design of professional correlation table, increase the fractionation field of independent of service, be distributed in the foundation of each node as data;
Identical field value is filled in the table design of identical services group;
When generating business datum, fill the data value of corresponding fractionation field according to the attribute configuration of business;
Each distributed buffer node is synchronized to the fractionation field value of same alike result in the buffer memory of this node when the data of synchronous this node.
Preferably, step S2 further comprises step:
During data change in central database; Trigger the trigger in the central database, the change type of trigger inspection data, the node ID that the data of inquiry change need be distributed from allocation list; Distributing data then generates the logic log of this corresponding node to certain node if desired;
Logic log is recorded in the data sync table;
Make regular check on the data in the data sync table, when existence needs synchronous logic log, from synchronous meter, take out logic log, get up the logic log batch combination of same node, be placed in the work queue of dispatch thread;
With the Context resolution of data sync table is corresponding logic log;
From log information in batches, parse the logic log of wall scroll, take out the content of logic log, modification is updated in the buffer memory.
Preferably, step S3 further comprises step:
From configuration file, read nodal information, through nodal information inquiry synchronous condition table;
The condition of inquiry synchrodata is also assembled the SQL statement of synchronous query data;
SQL statement through assembling is inquired about the data that are synchronized to this node, writes the data of inquiry in the buffer memory.
Preferably, step S4 further comprises step:
For each distribution node is specified corresponding user group;
When subscriber access system, the server of configure user visit is the distribution node at this user place;
Distribution node is this user's data synchronously, for the user provides the service to this user.
On the other hand, the present invention also provides a kind of data distributed buffer system simultaneously, and said system comprises central database and at least one distribution node; Wherein,
Said central database is made up of a plurality of Database Unit, is used for the whole business datums of storage and uniform and also is each business datum configuration node id information;
Each said distribution node comprises distribution cluster and at least one synchronization server; Said distribution cluster is made up of Distributor; Be used for the business datum of central database is taken out, and the node ID information entrained according to each data, data are distributed to corresponding synchronization server; Said synchronization server is used for obtaining the data that are distributed to this locality from Distributor, it is synchronized in the local buffer memory supplies user capture.
Again on the one hand, the present invention also provides a kind of data distributed buffer system simultaneously, and said system comprises:
Data memory module is used for when generating business datum or business datum and change, according to predefined collocation strategy each data being increased node ID information, with storage in central database;
The data distribution module is used to carry out the data distribution, the business datum in the central database taken out, and the node ID information entrained according to each data, data are distributed to the corresponding nodes server;
Data simultaneous module is used for taking out the data that are distributed to this node from node server, is synchronized in the buffer memory of this node;
Access control module is used for each customer group is linked into a specific node, and the user is through these nodal cache access service data.
Preferably, comprise the policy configurations module in the said data memory module, said policy configurations module further comprises:
The field design module is used for when carrying out the design of professional correlation table, increasing the fractionation field of independent of service, is distributed in the foundation of each node as data;
Table splits module, is used for identical field value is filled in the table design of identical services group;
The professional module that splits is used for when generating business datum, filling the data value of corresponding fractionation field according to the attribute configuration of business;
The synchronization policy module is used for when the data of each distributed buffer node at synchronous this node, being synchronized to the fractionation field value of same alike result in the buffer memory of this node.
Preferably, said data distribution module further comprises:
The daily record generation module; Be used for when the data change of central database; Trigger the trigger in the central database, the change type of trigger inspection data, the node ID that the data of inquiry change need be distributed from allocation list; Distributing data then generates the logic log of this corresponding node to certain node if desired;
Logging modle is used for logic log is recorded in the data sync table;
The poll module is used for making regular check on the data of data sync table, when existence needs synchronous logic log, from synchronous meter, takes out logic log, gets up the logic log batch combination of same node, is placed in the work queue of dispatch thread;
Tabulation is analysed module, and the Context resolution that is used for the data sync table is corresponding logic log;
Log analyzing module is used for parsing the logic log of wall scroll from log information in batches, takes out the content of logic log, and modification is updated in the buffer memory.
(3) beneficial effect
In the scheme of the present invention; Be divided into same group of data to the data of identical category attribute; Through the distribution process, be distributed to the business datum of same alike result in the buffer memory of user's visit recently then, offer business datum and use; Thereby reduce data cachedly, improve the access speed of data the taking of central database internal memory.
Description of drawings
Fig. 1 is the handling process sketch map of data distributed buffer method in the embodiments of the invention;
Fig. 2 is the structural representation of data distributed buffer system in the embodiments of the invention.
Embodiment
To combine the accompanying drawing in the embodiment of the invention below, the technical scheme in the embodiment of the invention is carried out clear, intactly description, obviously, described embodiment is a part of embodiment of the present invention, rather than whole embodiment.Based on the embodiment among the present invention, the every other embodiment that those of ordinary skills are obtained under the prerequisite of not making creative work belongs to the scope that the present invention protects.
A kind of processing method of data distributed buffer is provided in the embodiments of the invention; Be divided into same group of data to the data of identical category attribute; Through the distribution process, be distributed to the business datum of same alike result in the buffer memory of user's visit recently then, offer business datum and use; Thereby reduce data cachedly, improve the access speed of data the taking of central database internal memory.The present invention also can solve the problem of big data quantity visit simultaneously, and a kind of processing method of distributed buffer of mass data is provided.Referring to Fig. 1, data distributed buffer method of the present invention comprises step:
S1 when generating business datum or business datum and change, increases node ID information according to predefined collocation strategy to each data, with storage in central database;
S2 carries out the data distribution, the business datum in the central database taken out, and the node ID information entrained according to each data, data are distributed to the corresponding nodes server;
S3 takes out the data that are distributed to this node from node server, be synchronized in the buffer memory of this node;
S4 is linked into a specific node with each customer group, and the user is through these nodal cache access service data.
Particularly; The scheme that adopts in the embodiments of the invention is following: aspect networking; Employing center network's mode, promptly Centroid is disposed the unified data storehouse and is carried out the uniform data storage, the data of each distributed buffer node at first persistent storage in the database of Centroid.The data of distributed node are a sub-set of data in the central database, and the data of subclass can be configured the data of confirming in the subclass at central database according to the needs of business, and the data of each distributed node are the required data of this node.After the data change, the data of each distribution node through the distribution process the change data sync in each distribution node.During the service needed visit data, the business datum that directly reads in the distribution node provides service, and need not be concerned about that business datum is stored in the position in the database.According to foregoing description, the key technology of data distributed buffer method of the present invention mainly is divided into following several sections: data service distribution, data sync distribution and service data visitation control.
At first, the major function that the data service distribution realizes is the required data of configuration distribution node, and the mode of data based configuration is distributed to each cache node.This step further comprises the steps:
1, when carrying out the design of professional correlation table, increase the field of independent of service, promptly split field, be distributed in the foundation of each node as data;
2, the table of identical services group can design and fill identical field value;
When 3, generating business datum, fill the data value of corresponding fractionation field according to the attribute configuration of business;
4, each distributed buffer node is synchronized to the fractionation field value of same alike result in the buffer memory of this node when the data of synchronous this node.
For example: in the deployment that economizes net; Each districts and cities' node has a node ID; The field of the corresponding independent of service of this node ID meeting, like SplitId, the data of this node need split when distributing; To the value of data filling SplitId, the data with identical this SplitId value just are synchronized in the same node.
The major function of data sync distribution is to be responsible for synchronously and distributing data, and synchrodata can be when node initializing, data sync in buffer memory; The function of data distribution then is when the data change, is distributed to this corresponding nodes to the data that belong to certain node.So this step is subdivided into data sync or data distribution again, wherein data sync further comprises step:
1, from configuration file, reads nodal information,, comprise following information in the synchronous condition table: node ID, Table I D, condition ID, synchronous condition value through nodal information inquiry synchronous condition table;
2, the condition of inquiry synchrodata, the foundation of inquiry is through node ID, Table I D, inquires synchronous condition, and conditional information is a character string forms, and form is like " field name=%d and field name=%d ", and the value that %d is corresponding is stored in the condition table;
3, the SQL statement of assembling synchronous query data, assembling mode directly passes through the function sprintf function formation SQL statement of c language through in the condition value Writing condition character string;
4, be synchronized to the data of this node through the SQL statement inquiry of assembling, write the data of inquiry in the buffer memory, be i.e. the corresponding data of this node.
And the data distribution further comprises step:
1, during the data change in the central database; Trigger the trigger in the central database; The change type of trigger inspection data comprises insertion, renewal, perhaps deletion; The node ID that the data of inquiry change need be distributed from allocation list, distributing data then generates the logic log of this corresponding node to certain node if desired;
2, logic log is recorded in the data sync table, and the data sync table comprises following information: serial ID, node ID, Table I D, action type, table name, Major key, major key field name.
3, the distribution process initiation poll thread of distribution node is made regular check on the data in the data sync table, when existence needs synchronous logic log; From synchronous meter, take out logic log; Get up the logic log batch combination of same node, be placed in the work queue of dispatch thread, wait for that worker thread sends to node corresponding cache receiving process to logic log through the TCP connection; After the worker thread logic log sends successfully; Synchronously successful data in the deletion synchronous meter, and empty the data in the formation, the poll thread can continue to write synchronous logic log in the formation then;
4, there is corresponding corresponding relation in the content of logic log content and data sync table; Is corresponding logic log through corresponding relation with the Context resolution of data sync table, and the logic log content of parsing is: serial ID, node ID, Table I D, action type, Major key, record value; The method that the data sync table resolves to logic log is: take out the data sync table record; Insert corresponding content in the logic log; The serial ID of serial ID counterlogic daily record like table; The corresponding Major key of major key ID, the record value of logic log then takes out from database through table name, Major key, major key field name, then according to the binary record value of field type assembling becoming;
5, receiving process is waited for the logic log information that receives, and from log information in batches, parses the logic log of wall scroll, takes out the content of logic log, and modification is updated in the buffer memory; Through the setting of major key, can guarantee that daily record repeats and can not to produce data inconsistent.
At last, service data visitation control provides the mode of data route, with scope of business on the service server of appointment, thereby can have access to corresponding data.Under the deployment way of center, can be in each distribution node, according to attribute of user; The user is linked on the nearest node of user; User data for example, each user belongs to this user's node with access, thereby can have access to the data that belong to this node.Access control specifically comprises the steps:
1, the user group of each distribution node service appointment;
2, during subscriber access system, the server of configuration access is the distribution node server at this user place;
3, synchronous this user's data of distribution node, thus the service to this user can be provided.
Can know by foregoing description; Data distributed buffer of the present invention system is as shown in Figure 2; It mainly comprises: central database and at least one distribution node (among Fig. 2 be example with distribution node 2 two distribution nodes with distribution node 1); Wherein, said central database is formed (being total to n data library unit by database 1 to database n among Fig. 2 forms) by a plurality of Database Unit, is used for the whole business datums of storage and uniform and is each business datum configuration node id information; Each said distribution node comprises distribution cluster and at least one synchronization server; Said distribution cluster is made up of Distributor; Be used for the business datum of central database is taken out, and the node ID information entrained according to each data, data are distributed to corresponding synchronization server; Said synchronization server is used for obtaining the data that are distributed to this locality from Distributor, it is synchronized in the local buffer memory supplies user capture.Wherein, can adopt a plurality of Distributors to make up the distribution cluster with active and standby mode, among Fig. 2, two Distributors (main frame and standby host) have been formed HA (HighAvailable, high availability) group system.The buffer memory of this locality of each synchronization server is with each business datum of format management of database (among Fig. 2 be that example manage a plurality of business datums professional 1, professional 2 etc. with shineDB).
In addition; One of ordinary skill in the art will appreciate that; Realize that all or part of step in the foregoing description method is to instruct relevant hardware to accomplish through program, described program can be stored in the computer read/write memory medium, and this program is when carrying out; Each step that comprises the foregoing description method, and described storage medium can be: ROM/RAM, magnetic disc, CD, storage card etc.Therefore, corresponding with method of the present invention, the present invention also comprises a kind of data distributed buffer system simultaneously, and this system is usually to represent with the form of the corresponding functional module of each step of method; Said system comprises data memory module, data distribution module, data simultaneous module and access control module, wherein,
Data memory module is used for when generating business datum or business datum and change, according to predefined collocation strategy each data being increased node ID information, with storage in central database;
The data distribution module is used to carry out the data distribution, the business datum in the central database taken out, and the node ID information entrained according to each data, data are distributed to the corresponding nodes server;
Data simultaneous module is used for taking out the data that are distributed to this node from node server, is synchronized in the buffer memory of this node;
Access control module is used for each customer group is linked into a specific node, and the user is through these nodal cache access service data.
Adopt scheme of the present invention, have following clear superiority:
1, through distributed buffer method provided by the invention; Can be configured easily, data are distributed on the different distribution nodes, and be that the user who is distributed on this node provides service; Thereby reduce the data volume on each distribution node, improve the performance of data access;
2, data partition method provided by the invention and professional separate; And the method that provides data to distribute configuration; The realization of code in configuration of simplifying procedures, and a kind of simple method from the real-time synchrodata of physical database to distributed buffer is provided;
3, through data are distributed to different nodes, can independently be each incoherent node, thereby reduce interdepending of each node that the realization of simplified system reduces the configuration of each node server with system, reduce the cost of system group network.
Above execution mode only is used to explain the present invention; And be not limitation of the present invention; The those of ordinary skill in relevant technologies field under the situation that does not break away from the spirit and scope of the present invention, can also be made various variations and modification; Therefore all technical schemes that are equal to also belong to category of the present invention, and invention protection range of the present invention should be defined by the claims.
Claims (10)
1. data distributed buffer method is characterized in that said method comprises step:
S1 when generating business datum or business datum and change, increases node ID information according to predefined collocation strategy to each data, with storage in central database;
S2 carries out the data distribution, the business datum in the central database taken out, and the node ID information entrained according to each data, data are distributed to the corresponding nodes server;
S3 takes out the data that are distributed to this node from node server, be synchronized in the buffer memory of this node;
S4 is linked into a specific node with each customer group, and the user is through these nodal cache access service data.
2. method according to claim 1 is characterized in that, the whole business datums of storage and uniform in the said central database.
3. method according to claim 1 is characterized in that, among the step S1, said collocation strategy comprises:
When carrying out the design of professional correlation table, increase the fractionation field of independent of service, be distributed in the foundation of each node as data;
Identical field value is filled in the table design of identical services group;
When generating business datum, fill the data value of corresponding fractionation field according to the attribute configuration of business;
Each distributed buffer node is synchronized to the fractionation field value of same alike result in the buffer memory of this node when the data of synchronous this node.
4. method according to claim 1 is characterized in that, step S2 further comprises step:
During data change in central database; Trigger the trigger in the central database, the change type of trigger inspection data, the node ID that the data of inquiry change need be distributed from allocation list; Distributing data then generates the logic log of this corresponding node to certain node if desired;
Logic log is recorded in the data sync table;
Make regular check on the data in the data sync table, when existence needs synchronous logic log, from synchronous meter, take out logic log, get up the logic log batch combination of same node, be placed in the work queue of dispatch thread;
With the Context resolution of data sync table is corresponding logic log;
From log information in batches, parse the logic log of wall scroll, take out the content of logic log, modification is updated in the buffer memory.
5. method according to claim 1 is characterized in that, step S3 further comprises step:
From configuration file, read nodal information, through nodal information inquiry synchronous condition table;
The condition of inquiry synchrodata is also assembled the SQL statement of synchronous query data;
SQL statement through assembling is inquired about the data that are synchronized to this node, writes the data of inquiry in the buffer memory.
6. method according to claim 1 is characterized in that, step S4 further comprises step:
For each distribution node is specified corresponding user group;
When subscriber access system, the server of configure user visit is the distribution node at this user place;
Distribution node is this user's data synchronously, for the user provides the service to this user.
7. a data distributed buffer system is characterized in that, said system comprises central database and at least one distribution node; Wherein,
Said central database is made up of a plurality of Database Unit, is used for the whole business datums of storage and uniform and also is each business datum configuration node id information;
Each said distribution node comprises distribution cluster and at least one synchronization server; Said distribution cluster is made up of Distributor; Be used for the business datum of central database is taken out, and the node ID information entrained according to each data, data are distributed to corresponding synchronization server; Said synchronization server is used for obtaining the data that are distributed to this locality from Distributor, it is synchronized in the local buffer memory supplies user capture.
8. data distributed buffer system is characterized in that said system comprises:
Data memory module is used for when generating business datum or business datum and change, according to predefined collocation strategy each data being increased node ID information, with storage in central database;
The data distribution module is used to carry out the data distribution, the business datum in the central database taken out, and the node ID information entrained according to each data, data are distributed to the corresponding nodes server;
Data simultaneous module is used for taking out the data that are distributed to this node from node server, is synchronized in the buffer memory of this node;
Access control module is used for each customer group is linked into a specific node, and the user is through these nodal cache access service data.
9. system according to claim 8 is characterized in that, comprises the policy configurations module in the said data memory module, and said policy configurations module further comprises:
The field design module is used for when carrying out the design of professional correlation table, increasing the fractionation field of independent of service, is distributed in the foundation of each node as data;
Table splits module, is used for identical field value is filled in the table design of identical services group;
The professional module that splits is used for when generating business datum, filling the data value of corresponding fractionation field according to the attribute configuration of business;
The synchronization policy module is used for when the data of each distributed buffer node at synchronous this node, being synchronized to the fractionation field value of same alike result in the buffer memory of this node.
10. system according to claim 8 is characterized in that, said data distribution module further comprises:
The daily record generation module; Be used for when the data change of central database; Trigger the trigger in the central database, the change type of trigger inspection data, the node ID that the data of inquiry change need be distributed from allocation list; Distributing data then generates the logic log of this corresponding node to certain node if desired;
Logging modle is used for logic log is recorded in the data sync table;
The poll module is used for making regular check on the data of data sync table, when existence needs synchronous logic log, from synchronous meter, takes out logic log, gets up the logic log batch combination of same node, is placed in the work queue of dispatch thread;
Tabulation is analysed module, and the Context resolution that is used for the data sync table is corresponding logic log;
Log analyzing module is used for parsing the logic log of wall scroll from log information in batches, takes out the content of logic log, and modification is updated in the buffer memory.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210118227.7A CN102638584B (en) | 2012-04-20 | 2012-04-20 | Data distributing and caching method and data distributing and caching system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210118227.7A CN102638584B (en) | 2012-04-20 | 2012-04-20 | Data distributing and caching method and data distributing and caching system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102638584A true CN102638584A (en) | 2012-08-15 |
| CN102638584B CN102638584B (en) | 2014-11-19 |
Family
ID=46622825
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210118227.7A Active CN102638584B (en) | 2012-04-20 | 2012-04-20 | Data distributing and caching method and data distributing and caching system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102638584B (en) |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102916974A (en) * | 2012-11-07 | 2013-02-06 | 曙光信息产业股份有限公司 | Cluster configuration updating method |
| CN103440288A (en) * | 2013-08-16 | 2013-12-11 | 曙光信息产业股份有限公司 | Big data storage method and device |
| CN103595776A (en) * | 2013-11-05 | 2014-02-19 | 福建网龙计算机网络信息技术有限公司 | Distributed type caching method and system |
| WO2014094234A1 (en) * | 2012-12-18 | 2014-06-26 | Empire Technology Development Llc | Data caching based on social characteristics of users |
| CN103916479A (en) * | 2014-04-15 | 2014-07-09 | 大连理工大学 | Cloud synchronous local area network accelerating system based on working group document |
| CN104408056A (en) * | 2014-10-29 | 2015-03-11 | 中国建设银行股份有限公司 | Data processing method and device |
| CN104822076A (en) * | 2015-04-14 | 2015-08-05 | 天脉聚源(北京)传媒科技有限公司 | Data distribution method and device thereof |
| CN105357314A (en) * | 2015-12-03 | 2016-02-24 | 厦门速卖通网络科技有限公司 | Fixed point distributed cache system and cache method thereof |
| CN105630812A (en) * | 2014-10-30 | 2016-06-01 | 阿里巴巴集团控股有限公司 | Refreshing method and device of cluster application cache |
| CN105765569A (en) * | 2014-11-05 | 2016-07-13 | 华为技术有限公司 | Data distribution method, loader and storage system |
| CN106202437A (en) * | 2016-07-14 | 2016-12-07 | 上海超橙科技有限公司 | A kind of data managing method and equipment |
| CN106713470A (en) * | 2016-12-29 | 2017-05-24 | 北京奇艺世纪科技有限公司 | Distributed cache updating method and cache updating system |
| CN107015758A (en) * | 2016-01-28 | 2017-08-04 | 胡敏 | A kind of new distribution type memory buffers accelerated method |
| CN107200248A (en) * | 2017-05-22 | 2017-09-26 | 安徽奥里奥克科技股份有限公司 | A kind of elevator Internet of Things network operation real-time monitoring system based on cloud platform |
| CN107426304A (en) * | 2017-07-06 | 2017-12-01 | 努比亚技术有限公司 | Method, system and the proxy server of interactive media resource |
| CN108401026A (en) * | 2018-02-26 | 2018-08-14 | 深圳智乾区块链科技有限公司 | Date storage method, system based on block chain and computer readable storage medium |
| CN109446271A (en) * | 2018-10-31 | 2019-03-08 | 阿里巴巴集团控股有限公司 | A kind of method of data synchronization, device, equipment and medium |
| CN110557269A (en) * | 2018-05-31 | 2019-12-10 | 阿里巴巴集团控股有限公司 | Service data processing method and system and data processing method |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040128470A1 (en) * | 2002-12-27 | 2004-07-01 | Hetzler Steven Robert | Log-structured write cache for data storage devices and systems |
| CN101826073A (en) * | 2009-03-06 | 2010-09-08 | 华为技术有限公司 | Synchronous method, apparatus and system for distributed database |
| CN102006330A (en) * | 2010-12-01 | 2011-04-06 | 北京瑞信在线系统技术有限公司 | Distributed cache system, data caching method and inquiring method of cache data |
-
2012
- 2012-04-20 CN CN201210118227.7A patent/CN102638584B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040128470A1 (en) * | 2002-12-27 | 2004-07-01 | Hetzler Steven Robert | Log-structured write cache for data storage devices and systems |
| CN101826073A (en) * | 2009-03-06 | 2010-09-08 | 华为技术有限公司 | Synchronous method, apparatus and system for distributed database |
| CN102006330A (en) * | 2010-12-01 | 2011-04-06 | 北京瑞信在线系统技术有限公司 | Distributed cache system, data caching method and inquiring method of cache data |
Cited By (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102916974A (en) * | 2012-11-07 | 2013-02-06 | 曙光信息产业股份有限公司 | Cluster configuration updating method |
| WO2014094234A1 (en) * | 2012-12-18 | 2014-06-26 | Empire Technology Development Llc | Data caching based on social characteristics of users |
| US10235451B2 (en) | 2012-12-18 | 2019-03-19 | Empire Technology Development Llc | Data caching based on social characteristics of users |
| CN103440288A (en) * | 2013-08-16 | 2013-12-11 | 曙光信息产业股份有限公司 | Big data storage method and device |
| CN103595776A (en) * | 2013-11-05 | 2014-02-19 | 福建网龙计算机网络信息技术有限公司 | Distributed type caching method and system |
| CN103916479A (en) * | 2014-04-15 | 2014-07-09 | 大连理工大学 | Cloud synchronous local area network accelerating system based on working group document |
| CN103916479B (en) * | 2014-04-15 | 2017-05-03 | 大连理工大学 | Cloud synchronous local area network accelerating system based on working group document |
| CN104408056A (en) * | 2014-10-29 | 2015-03-11 | 中国建设银行股份有限公司 | Data processing method and device |
| CN104408056B (en) * | 2014-10-29 | 2020-09-15 | 中国建设银行股份有限公司 | Data processing method and device |
| CN105630812A (en) * | 2014-10-30 | 2016-06-01 | 阿里巴巴集团控股有限公司 | Refreshing method and device of cluster application cache |
| CN105765569A (en) * | 2014-11-05 | 2016-07-13 | 华为技术有限公司 | Data distribution method, loader and storage system |
| CN104822076A (en) * | 2015-04-14 | 2015-08-05 | 天脉聚源(北京)传媒科技有限公司 | Data distribution method and device thereof |
| CN105357314A (en) * | 2015-12-03 | 2016-02-24 | 厦门速卖通网络科技有限公司 | Fixed point distributed cache system and cache method thereof |
| CN107015758A (en) * | 2016-01-28 | 2017-08-04 | 胡敏 | A kind of new distribution type memory buffers accelerated method |
| CN106202437A (en) * | 2016-07-14 | 2016-12-07 | 上海超橙科技有限公司 | A kind of data managing method and equipment |
| CN106713470A (en) * | 2016-12-29 | 2017-05-24 | 北京奇艺世纪科技有限公司 | Distributed cache updating method and cache updating system |
| CN107200248A (en) * | 2017-05-22 | 2017-09-26 | 安徽奥里奥克科技股份有限公司 | A kind of elevator Internet of Things network operation real-time monitoring system based on cloud platform |
| CN107426304A (en) * | 2017-07-06 | 2017-12-01 | 努比亚技术有限公司 | Method, system and the proxy server of interactive media resource |
| CN108401026A (en) * | 2018-02-26 | 2018-08-14 | 深圳智乾区块链科技有限公司 | Date storage method, system based on block chain and computer readable storage medium |
| CN110557269A (en) * | 2018-05-31 | 2019-12-10 | 阿里巴巴集团控股有限公司 | Service data processing method and system and data processing method |
| CN109446271A (en) * | 2018-10-31 | 2019-03-08 | 阿里巴巴集团控股有限公司 | A kind of method of data synchronization, device, equipment and medium |
| CN109446271B (en) * | 2018-10-31 | 2023-02-14 | 创新先进技术有限公司 | Data synchronization method, device, equipment and medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102638584B (en) | 2014-11-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102638584B (en) | Data distributing and caching method and data distributing and caching system | |
| CN109783438B (en) | Distributed NFS system based on librados and construction method thereof | |
| CN101493826B (en) | Database system based on WEB application and data management method thereof | |
| RU2591169C2 (en) | Database control system | |
| CN107832401B (en) | Database data access method, system, device and computer readable storage medium | |
| CN103488581B (en) | Data buffering system and data cache method | |
| CN104252536B (en) | A kind of internet log data query method and device based on hbase | |
| CN103164525B (en) | WEB application dissemination method and device | |
| CN101169785A (en) | Clustered database system dynamic loading balancing method | |
| US20110153606A1 (en) | Apparatus and method of managing metadata in asymmetric distributed file system | |
| CN102541990A (en) | Database redistribution method and system utilizing virtual partitions | |
| CN103020204A (en) | Method and system for carrying out multi-dimensional regional inquiry on distribution type sequence table | |
| CN1307584C (en) | Method for implementing tree storage and access by two-dimensional table | |
| CN101770515A (en) | Data block comparison based data updating method | |
| CN102663117A (en) | OLAP (On Line Analytical Processing) inquiry processing method facing database and Hadoop mixing platform | |
| CN103177027A (en) | Method and system for obtaining dynamic feed index | |
| CN103631820B (en) | The metadata management method and equipment of distributed file system | |
| CN101102577A (en) | Incremental synchronization method for data in tables of frontground and background database of wireless communication base station system | |
| CN102685552B (en) | Error pattern generator (EPG) content metadata management method, server and system | |
| CN102523285A (en) | Storage caching method of object-based distributed file system | |
| CN102722405B (en) | Counting method and system in high concurrent and multithreaded application | |
| CN103853714A (en) | Data processing method and device | |
| CN107888666A (en) | A kind of cross-region data-storage system and method for data synchronization and device | |
| CN103179193A (en) | Data transmission system and data transmission method used for distributed application system | |
| CN103778908A (en) | Karaoke member VOD system and VOD method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C41 | Transfer of patent application or patent right or utility model | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20170123 Address after: 266100 Shandong Province, Qingdao city Laoshan District Songling Road No. 399 Patentee after: Poly Polytron Technologies Inc Address before: 266071 Laoshan, Qingdao province Hongkong District No. East Road, room 248, room 131 Patentee before: Hisense Media Networks Co., Ltd. |