WO2009097710A1

WO2009097710A1 - Method for organizing and retrieving files, module and system for organizing files and storage media thereof

Info

Publication number: WO2009097710A1
Application number: PCT/CN2008/071908
Authority: WO
Inventors: Wentao Yang; Kegang Dou
Original assignee: Huawei Technologies Co., Ltd.
Priority date: 2008-02-01
Filing date: 2008-08-07
Publication date: 2009-08-13
Also published as: CN101226546A; CN101226546B

Abstract

A method for organizing files is disclosed. The method comprises the steps of: obtaining at least one set of files; merging all the files in each of the sets of files into a storage node; establishing index for retrieving the files merged into the storage node. A method for retrieving files, a module for organizing files, a system for retrieving files and a computer readable storage media are still disclosed.

Description

Document organization, retrieval method, file organization module, system and storage medium

The present invention relates to the field of communications, and in particular, to a file organization method, a file retrieval method, a file organization module, a file retrieval system, and a computer readable storage medium. Background technique

Now in the telecommunications industry, especially in the overseas telecommunications industry, users' consumption and amount-related information are required to be displayed on the bill to the user, and advertisements can be posted or inserted on the bill to inform the user of new activities and new offers. Policy, or other market promotion. The bills are stored on the storage module in the form of a file before the conversion is printed or displayed by the tool. This type of file is called a billing document. The billing file has the following characteristics:

Al, small file;

A2, the number of documents is large;

A3. Finding and locating a file is inefficient;

A4. Modifying the content of each file is inefficient;

A5, the occupied storage space is large.

On the one hand, the number of files is too large, which wastes the storage nodes (storage space) of the file system; on the other hand, when a large number of files are searched and located, the efficiency is low, and in specific applications, in the business operation support system (Business Operation Support System) In BOSS, the billing file has low efficiency in finding and positioning, which makes the printing (presentation) and reprinting speed of the billing file slow, which reduces the experience satisfaction of the user's billing service. Summary of the invention

The technical problem to be solved by the embodiments of the present invention is to provide a file organization method, a file retrieval method, a file organization module, a file retrieval system and a computer readable storage medium, which can solve The number of files is too large, resulting in wasted storage space and low file location efficiency.

In order to solve the above technical problem, an embodiment of the present invention provides a method for organizing a file, including: obtaining at least one file set; Combining all the files in each of the file sets into one storage node; establishing an index for retrieving the merged files under the storage node.

The embodiment of the invention further provides a file retrieval method, including:

Receiving a read request for reading a file in the merged file set under the storage node; obtaining, according to the read request, an index for retrieving a file in the merged file set under the storage node and the file set ;

A file corresponding to the index in the file set is output.

Correspondingly, an embodiment of the present invention further provides a file organization module, including:

Obtaining a submodule, configured to obtain at least one file set;

a merging submodule for merging all the files in each of the file sets into one storage node;

An index creation sub-module is configured to retrieve an index of the merged file under the storage node.

Correspondingly, an embodiment of the present invention further provides a file retrieval system, including:

a storage module, where the storage module corresponds to at least one storage node, configured to store an index for retrieving files in the merged file set under the storage node, and the file set;

a master control module, configured to receive a read request for reading a file in a file set merged under the storage node, and output corresponding control information according to the read request;

a file retrieval module, according to the control information of the total control module, obtaining an index for retrieving a file in the file set merged under the storage node and the file set, and outputting the index and the file from the storage module Collection

And a file output module, configured to output a file corresponding to the index in the file set.

Correspondingly, an embodiment of the present invention further provides a computer readable storage medium, where the computer readable storage medium stores a plurality of executable instructions, where the executable instructions are used to:

Obtain at least one file collection;

Combine all the files in each of the file sets into one storage node;

Establishing an index for retrieving the merged file under the storage node.

In the embodiment of the present invention, by obtaining at least one file set, and merging all the files in each file set into one storage node, an index for retrieving the merged file under the storage node is established, thereby solving the problem due to the number of files. Too much, causing wasted storage space; and receiving the text in the merged file set under the storage node based on the above-structured file and index storage relationship Reading a read request, and searching and outputting the file corresponding to the read request according to an index for retrieving a file in the file set merged under the storage node, thereby solving the problem of low file positioning efficiency. Improve user experience satisfaction. DRAWINGS

1 is a schematic diagram of a method of organizing a file according to an embodiment of the present invention;

2 is a schematic diagram of a file storage structure established in an embodiment of the present invention;

3 is a schematic diagram of a file organization module according to an embodiment of the present invention;

4 is a schematic diagram of a document retrieval system according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of a method of retrieving a file according to an embodiment of the present invention. detailed description

The embodiments of the present invention are described in detail below with reference to the accompanying drawings.

1 is a schematic diagram of a method for organizing a file according to an embodiment of the present invention, where the method includes:

101. classify files to obtain at least one file set; each file set corresponds to each classification result, that is, forms a file collection of a certain class or classes, and in a specific implementation, a hash algorithm may be used. Documents are classified, but are not limited to this;

102. Create a directory structure for each type of file collection; the directory file in the directory structure corresponds to each type of file set. In specific implementation, a hash algorithm may be used to establish a directory structure for each file set, but is not limited thereto;

103. Obtain the above-mentioned various file sets, and merge all the files in each type of file set into one storage node;

104. Establish an index for retrieving the merged file under the storage node; in a specific implementation, the index organization may adopt a B+ tree form, and the above description is equally applicable to other embodiments of the present invention.

The file storage structure established above can be as shown in FIG. 2, including the total directory structure f(y), the file f(x) in the directory under the directory structure, the index (idx file), and the packed compression node (.tar. Gz), merged files (numbering from 1.256900 to 1.659900, numbering from 1.348699 to 1.648699, etc.).

As an implementation manner, between 103 and 104, the method may further include:

The files under each merged storage node are packaged and compressed.

In addition, 101, 102 can be selected according to the actual situation. As an implementation manner, when a file in a storage structure of the created file is to be added, deleted, or modified, an index corresponding to the file may be updated according to an operation of adding, deleting, or modifying the file.

(idx file), maintenance of the cable 1.

As an embodiment, the above file may be a bill file, or other type of file.

The method for organizing the file in the embodiment of the present invention as shown in FIG. 1 can solve the problem of storing the file by categorizing the file, establishing a directory structure, merging under a storage node, and establishing an index. The problem of wasted space.

Accordingly, the modules and systems of the embodiments of the present invention are described below.

3 is a schematic diagram of a file organization module according to an embodiment of the present invention. Referring to FIG. 3, the file organization module includes a classification sub-module 41, a directory establishment sub-module 42, an acquisition sub-module 43, a merge sub-module 44, and an index establishment sub-module 45. The function of each submodule is as follows:

a classification sub-module 41, configured to classify files, obtain at least one file set, and each file set corresponds to each classification result, that is, form a file collection of a certain class or classes;

The directory creation sub-module 42 is configured to establish a directory structure for each type of file collection obtained by classifying the sub-module 41, and the directory file in the directory structure corresponds to each type of file set;

In a specific implementation, the algorithm of the classification process of the classification sub-module 41 or the process of establishing the directory structure of the directory creation sub-module 42 may be a hash algorithm;

The obtaining sub-module 43 is configured to obtain various types of file sets obtained by the classification processing of the classification sub-module 41. The merging sub-module 44 is configured to merge all the files in each type of file set obtained by the obtaining sub-module 43 into one storage. Under the node;

The index establishing sub-module 45 establishes an index for retrieving the merged file under the storage node. In the specific implementation, the index organization may adopt the form of a B+ tree, and the above description is also applicable to other embodiments of the present invention.

Each of the above functional units performs a corresponding function, and the created file storage structure can still be as shown in FIG. 2. As an implementation manner, all files in each merged file set in the merge submodule 44 may be package compressed by a package compression submodule.

In addition, the classification sub-module 41 and the directory creation sub-module 42 may be selected according to actual conditions. As an implementation manner, when a file in the storage structure of the created file is to be added, deleted, or modified, the index corresponding to the file may be updated by the index maintenance submodule according to the adding, deleting, or modifying operation of the file. (idx file), the index is maintained. As an embodiment, the above file may be a bill file, or other type of file.

The file organization module of the embodiment of the present invention as shown in FIG. 3 is implemented. By classifying files by different sub-modules, establishing a directory structure, merging under a storage node, and establishing an index, the number of files can be solved. The problem of wasted storage space.

On the basis of the storage structure of the file structure of the file organization module of the embodiment of the present invention, the embodiment of the present invention further provides a storage module, which stores the storage structure of the file constructed as described above.

4 is a schematic diagram of a file retrieval system according to an embodiment of the present invention. Referring to FIG. 4, the system mainly includes a storage module 51, a general control module 52, a file retrieval module 53, a file generation module 54, a file organization module 55, and a file output module 56. The bill presentation processing module 57 has the following functions:

a storage module 51, the storage module 51 corresponding to the at least one storage node, configured to store an index for retrieving a bill file in the merged file set under the storage node, and the file set, the bill in the storage module 51 The storage structure of the file may still be as shown in FIG. 2, and details are not described herein again;

The receiving submodule in the master control module 52 receives the read request of the bill presentation processing module 57 to read the bill file in the file set merged under the storage node in the storage module 51, and the read request may be a print request or a reprint request for a billing file;

The control submodule in the master control module 52 determines whether the bill file corresponding to the read request is in the request queue, and if so, outputs first control information for controlling the bill file corresponding to the read request The first control information carries a request queue number. Otherwise, the output is used to control the file retrieval module 53 to obtain an index from the storage module 51 for retrieving the bill file in the file set merged under the storage node. And the second control information of the file set, the second control information includes the read request and the index key value, and the file retrieval module 53 may retrieve the index and the file set according to the index key value;

The file output module 56, according to the first control information, directly transmits the bill file to the bill presentation processing module 57 in the form of a file stream, and the bill presentation processing module 57 may include a bill presentation processing program; the file retrieval module And obtaining, according to the second control information, an index for retrieving a bill file in the file set merged under the storage node, and the file set, and obtaining the obtained index and file from the storage module 51. The collection is transmitted to the file output module 56;

The file output module 56 reads the file set and index sent from the file retrieval module 53, selects the corresponding bill file in the file set according to the index, and transmits the bill file to the bill presentation processing module as a file stream. 57, whereby the bill presentation processing module 57 triggers printing according to the bill file Or reprint the operation to complete the bill presentation;

The control submodule in the master control module 52, after obtaining the obtained result information returned by the file retrieval module 53, the obtaining result information instructing the file retrieval module 53 not to obtain the index and the file set from the storage module 51, Sending, to the file generation module 54, third control information for controlling generation of a bill file of the user;

The file generating module 54 generates a bill file of the user according to the third control information of the master control module 52, and the file generating module 54 may include a file generating program;

The file organization module 55, according to the fourth control information of the master control module 52, organizes the bill file generated by the file generating module 54 into the storage module 51, and the file organization module 55 can The function of the file organization module shown in FIG. 3 processes the generated bill file, and sends the processed bill file to the storage module 51 for storage;

The file retrieval module 53 can obtain the generated bill file from the storage module 51, and add the index sent by the total control module 52, and the file retrieval module 53 can obtain the file set for retrieving the merged file under the storage node. The index of the billing file and the set of files are transferred to the file output module 56 to complete the bill presentation.

As an embodiment, when the bill file is in the form of a compressed package, that is, each file set is packaged and compressed, the file output module 56 specifically includes:

a compressed stream processing module, after reading the file set and index sent by the file retrieval module 53 (the bill file in the file set exists in the form of a compressed package), decompressing the bill corresponding to the index in the file set Document

The output module transmits the bill file obtained by decompressing the compressed stream processing module to the bill presentation processing module 57 in the form of a file stream.

As an embodiment, the above document retrieval system can be applied to a bill presentation subsystem in BOSS.

It should be noted that the file generating module 54 and the file organization module 55 may select the application according to the actual situation. When the file organization module 55 is not used, the bill file may be organized in a fixed format.

Implementing a file retrieval system according to an embodiment of the present invention as shown in FIG. 4, receiving, by different modules, a read request for reading a file in a file set merged under a storage node, according to a search for retrieving the storage node Index of the file in the file collection, obtaining and outputting the file corresponding to the read request, which can solve the problem of low file positioning efficiency; using the total control and module scheduling mechanism, and more capable of realizing on-demand Fast scheduling improves user experience satisfaction.

FIG. 5 is a schematic diagram of a file retrieval method according to an embodiment of the present invention. The method is based on the storage structure of the file created in FIG. 2, referring to FIG. 5, in conjunction with the system shown in FIG. 4, the method includes:

301. The master control module receives a read request of the bill presentation processing module to read the bill file in the merged file set under the storage node. In specific implementation, the read request may be a print request of the bill file or Reprint the request, but not limited to this;

302, the master control module determines whether the read request is in an existing request queue, and if so, directly notifies the file output module of the request queue number, and then the file output module directly transmits the bill file to the account as a file stream. Single presentation processing module, complete bill presentation, otherwise execute 303;

It should be noted that the request queue set by the embodiment of the present invention can implement the recently used bill file to be cached in the request queue, so as to quickly dispatch the bill file to the bill presentation processing module for processing, and the request queue The bill file that is not used in the medium and long term can be cleared periodically. In specific implementation, a time can be set. When the set time is exceeded, the bill file is cleared to save the request queue resource;

303, the control module, according to the read request, the control file retrieval module obtains, from the storage module, an index for retrieving the bill file in the merged file set under the storage node, and the file set. The control module generates control information for the file retrieval module to include the read request and the index key value, and the file retrieval module may retrieve the index and the file set according to the index key value;

304, the file retrieval module transfers the obtained index and file set to the file output module;

305, the file output module reads the file collection and index sent by the file retrieval module, and selects a corresponding bill file in the file collection according to the index;

306. The file output module transmits the bill file to the bill presentation processing module in a file stream, so that the bill presentation processing module can trigger a printing or reprinting operation on the bill file to complete the bill presentation.

As an embodiment, when the file retrieval module does not obtain the index from the storage module

307. The master control module obtains the obtained result information returned by the file retrieval module, where the obtained result information indicates that the file retrieval module does not obtain the index and the file set from the storage module.

308. The master control module control file generating module generates a bill file of the user.

309. The master control module simultaneously controls the file organization module to perform the generated billing statement as shown in FIG. Organize the pieces;

310, the master control module sends the index corresponding to the generated billing file to the file retrieval module;

311. The file generation module sends the generated bill file of the user to the file organization module, and the file organization module can process the generated bill file according to the process of the organization method of the file shown in FIG. 1;

312. The file organization module sends the processed bill file to the storage module for storage.

After 312, the file retrieval module can obtain the generated bill file from the storage module, and add the index sent by the total control module 310, and the file retrieval module can perform the corresponding function of 304 to complete the bill presentation.

As an embodiment, when the bill file exists in a compressed package, that is, each file set is packaged and compressed, the above 305 is specifically:

After the file output module reads the file set and the index sent by the file retrieval module (the bill file in the file set exists in the form of a compressed package), decompress the bill file corresponding to the index in the file set, and then The processing of the decompressed bill file is performed 306. To improve efficiency, partial decompression of the corresponding bill file may be performed according to the index, without decompressing all of the file set.

Implementing a retrieval method of a file according to an embodiment of the present invention as shown in FIG. 5, by receiving a read request for reading a file in a file set merged under a storage node, according to a file for retrieving the merged storage node Index of the file in the collection, obtaining and outputting the file corresponding to the read request, which can solve the problem of low file positioning efficiency; using the total control and module scheduling mechanism, can realize on-demand fast scheduling, and improve the user's Experience satisfaction.

In the meantime, the embodiment of the present invention further provides a computer readable storage medium, where the computer readable storage medium stores a plurality of executable instructions, where the executable instructions are used to:

Obtain at least one file collection;

Combine all the files in each of the file sets into one storage node;

Establishing an index for retrieving the merged file under the storage node.

In addition, one of ordinary skill in the art can understand that all or part of the process in implementing the foregoing embodiments may be completed by a program instructing related hardware, and the program may be stored in a computer readable storage medium. The program, when executed, may include the flow of an embodiment of the methods as described above. The storage medium may be a magnetic disk, an optical disk, or a read-only memory (Read-Only Memory, ROM) or random access memory (RAM).

The above is a specific embodiment of the present invention. It should be noted that those skilled in the art can also make several improvements and retouchings without departing from the principles of the present invention. These improvements and retouchings are also considered. It is the scope of protection of the present invention.

Claims

Rights request

A method for organizing a file, comprising:

Obtain at least one file collection;

Combine all the files in each of the file collections into one storage section

Establishing an index for retrieving the merged file under the storage node.

2. The method of organizing a file according to claim 1, wherein the method further comprises: classifying the file to obtain the at least one file set, and each of the file sets corresponds to each of the classification results .

3. The method of organizing a file according to claim 1, wherein the method further comprises: establishing a directory structure for the at least one file set, the directory file in each of the directory structures and each of the files The collection corresponds.

4. The method of organizing a file according to claim 2 or 3, characterized in that the hash algorithm is used for classification or a directory structure is established.

The method of organizing a file according to any one of claims 1 to 3, wherein the method further comprises:

The package compresses the merged file.

Updating the index corresponding to the file according to the adding, deleting or modifying operation of the file.

7. A method for retrieving a file, comprising:

Receiving a read request for reading a file in the merged file set under the storage node; obtaining, according to the read request, an index for retrieving a file in the merged file set under the storage node and the file set ; A file corresponding to the index in the file set is output.

The method for retrieving a file according to claim 7, wherein the method further comprises: determining whether a file corresponding to the read request is in a request queue, and if so, reading the request in the request queue Request the corresponding file output.

The method for retrieving a file according to claim 7, wherein the method further comprises: generating the file when the index and the file set are not obtained, and correspondingly indexing the generated file Output

The generated file is organized and stored to obtain the stored file.

The method for retrieving a file according to claim 7, wherein when the file exists in a compressed package, the outputting the file corresponding to the index in the file set specifically includes: a file corresponding to the index in the file set;

The decompressed file is output.

The method for retrieving a document according to any one of claims 7 to 9, characterized in that the file is a bill file.

12. A file organization module, comprising:

Obtaining a submodule, configured to obtain at least one file set;

13. The file organization module of claim 12, further comprising:

The file organization module of claim 12, further comprising: And a directory establishing submodule, configured to establish a directory structure for the at least one file set, where the directory file in each directory structure corresponds to each of the file sets.

15. A document retrieval system, comprising:

The file retrieval system according to claim 15, wherein the master control module comprises: a receiving submodule, receiving the read request;

Controlling the submodule, determining whether the file corresponding to the read request is in the request queue, and if so, outputting first control information for controlling output of the file corresponding to the read request in the request queue, otherwise, outputting Controlling the file retrieval module to obtain, from the storage module, an index for retrieving a file in the merged file set under the storage node and second control information of the file set.

The file retrieval system according to claim 15, wherein the system further comprises: a file generation module, when the file retrieval module does not obtain the index and the file collection, according to the total The third control information of the control module generates the file;

The file organization module organizes the files generated by the file generation module and stores them in the storage module.

The file retrieval system according to claim 15, wherein when the file exists in a compressed package form, the file output module comprises:

a compressed stream processing module, configured to decompress a file corresponding to the index in the file set, and an output module, configured to output the decompressed file.

The document retrieval system according to any one of claims 15 to 17, wherein the document is a bill file, and the system is applied to a bill presentation subsystem in a business operation support system.

20. A computer readable storage medium, the computer readable storage medium storing a plurality of executable instructions, wherein the executable instructions are:

Obtain at least one file collection;

Combine all the files in each of the file sets into one storage node;

Establishing an index for retrieving the merged file under the storage node.