CN105242883A - Disk array virtualization-based storage experiment system and method - Google Patents

Disk array virtualization-based storage experiment system and method Download PDF

Info

Publication number
CN105242883A
CN105242883A CN201510669450.4A CN201510669450A CN105242883A CN 105242883 A CN105242883 A CN 105242883A CN 201510669450 A CN201510669450 A CN 201510669450A CN 105242883 A CN105242883 A CN 105242883A
Authority
CN
China
Prior art keywords
configuration data
client
disk array
storage
server end
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510669450.4A
Other languages
Chinese (zh)
Other versions
CN105242883B (en
Inventor
丁振强
戴毅
刘志雄
邱韶杰
李云飞
周丹
贾理淳
姚勇
涂同斌
马劲松
刘国锋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhihuirong cloud information technology (Shenzhen) Co.,Ltd.
Original Assignee
Shenzhen Xunfang Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Xunfang Technology Co Ltd filed Critical Shenzhen Xunfang Technology Co Ltd
Priority to CN201510669450.4A priority Critical patent/CN105242883B/en
Publication of CN105242883A publication Critical patent/CN105242883A/en
Application granted granted Critical
Publication of CN105242883B publication Critical patent/CN105242883B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The invention relates to the field of computer storage, and discloses a disk array virtualization-based storage experiment system and method. The system comprises a client side, a server side and network storage equipment, wherein the client side is used for storing an experiment operation and transmitting a configuration data loading application request and a configuration data storage request to the server side; the server side is used for processing the configuration data loading request and the configuration data storage request from the client side; the server side comprises virtual storage equipment, a client side request processing layer and a hardware equipment interaction layer; and the network storage equipment is used for executing configuration data and returning the configuration data processing result to the client side. According to a virtualization technology-based disk array system built by simulating a real disk array provided by the invention, the utilization rate and the experiment efficiency of the storage equipment when a plurality of students simultaneously carry out a storage experiment are fully improved.

Description

Based on storage experimental system and the method for disk array virtualization
[technical field]
The present invention relates to Computer Storage field, particularly relate to a kind of storage experimental system based on disk array virtualization and method.
[background technology]
Store in experiment in colleges and universities' information, adopt disk array memory device, due to apparatus expensive, so often a laboratory only has a set of network storage equipment, if many students carry out on line operation will cause data invalid and inconsistence problems simultaneously, if and carry out causing the problems such as experimental period is long, plant factor is low with student queueing form, namely limited hardware resource cannot meet existing experiment model.
[summary of the invention]
The object of the invention is to be to provide a kind of storage experimental system based on disk array virtualization and method, for solving the not high problem of memory device experiment utilization factor.
On the one hand, the invention provides a kind of storage experimental system based on disk array virtualization, comprise client, server end and the network storage equipment, wherein:
Described client comprises multiple groups of clients, described client is for storing experimental implementation, business checking and sending configuration data storage resource request and configuration data load request to server end, described configuration data derives from client and stores experiment, for performing storage operational order;
The application configuration data storage resource request that described server end sends for the treatment of described client and configuration data load request, configuration data storage resource request is that request is stored into virtual disk array corresponding virtualized storage configuration data from client, configuration data load request is that request to be loaded into configuration data the network storage equipment from virtual disk array and to perform, wherein, described server end comprises a virtualized storage;
Described virtualized storage comprises multiple virtualized disk array, each virtualized disk array correspond to the part disk in the described network storage equipment, each virtualized disk array and described client one_to_one corresponding, a client correspond to a virtual disk array, each client operation be corresponding virtual disk array, the operational order of corresponding client that what each virtual disk array stored is, described operational order is configuration data, configuration data in described virtual disk array is loaded into the described network storage equipment according to the instruction of client by described server end, after processing configuration data loading, the configuration data result that the described network storage equipment returns by described server end feeds back to described client, verify to make client finishing service,
The described network storage equipment is for performing configuration data and returning configuration data result to client by server end;
Described client is also for receiving described configuration data result.
In certain embodiments, described server end also comprises client-requested processing layer, and described client-requested processing layer connects described client and described virtualized storage respectively; Described client-requested processing layer is for the treatment of from the configuration data storage resource request of client and configuration data load request.
In certain embodiments, described server end also comprises hardware device interbedded formation, and it connects described virtualized storage and the described network storage equipment respectively; Described hardware device interbedded formation accepts the request that described virtualized storage sends, safeguard the mapping of the configuration data in described virtual disk array to the described network storage equipment, processing configuration Data import, wherein, described configuration data, when loading, supports different clients loaded in parallel.
In certain embodiments, the virtual disk array state in described virtualized storage is determined by a series of preorder orders that described virtual disk array is corresponding, and described a series of preorder order is sent by the client that described virtual disk array is corresponding.
In certain embodiments, described server end all adopts the Socket communication technology to carry out growing being connected with described client, described server end with the described network storage equipment.
On the other hand, the invention provides a kind of storage experimental technique based on disk array virtualization, comprise the following steps:
Disk association is carried out to the disk array of the virtualized storage of server end, namely described disk association determines the incidence relation of disk group in each virtual disk array and the described network storage equipment, the disk group associated by the disk array of described virtualized storage and client one_to_one corresponding;
Client completes and stores experiment, and client sends configuration data storage resource request and configuration data load request;
Server-side processes client-requested, the configuration data storing experiment is saved in the virtual disk array of the virtualized storage of server end, and the configuration data preserved in the virtual disk array of virtualized storage is loaded into the described network storage equipment;
The network storage equipment performs configuration data, and configuration data result is fed back to client by server end, and client finishing service is verified.
In certain embodiments, described server end by the process of client-requested processing layer from the configuration data storage resource request of client and configuration data load request; Described server end accepts the request of described virtualized storage transmission by hardware device interbedded formation, safeguard the mapping of the configuration data corresponding disk group in the described network storage equipment in described virtual disk array, processing configuration Data import, when configuration data is loaded into the described network storage equipment from described virtualized storage, loaded in parallel between different clients.
In certain embodiments, the state of described virtual disk array is determined by a series of preorder orders that described virtual disk array is corresponding, and described a series of preorder order is sent by the client that described virtual disk array is corresponding.
In certain embodiments, described server end all adopts the Socket communication technology to carry out growing being connected with described client, described server end with the described network storage equipment.
Beneficial effect of the present invention be by the limited network storage equipment resource grouping utilize, solve student do store experiment time conventional efficient and plant factor problem, both improve conventional efficient and plant factor, maintained again the authenticity of experimental implementation.。Set up virtualized memory device and carry out disk stripping, solving the problem that user waits in line, substantially increasing plant factor and response speed, and ensure that the authenticity of operation in device authentication link.
[accompanying drawing explanation]
Fig. 1 is the structured flowchart of the storage experimental system based on disk array virtualization that the embodiment of the present invention 1 provides;
Fig. 2 is the concrete structure block diagram of the storage experimental system 210 based on disk array virtualization that the embodiment of the present invention 1 provides;
Fig. 3 is the process flow diagram of the storage experimental technique based on disk array virtualization that the embodiment of the present invention 2 provides.
[embodiment]
In order to make object of the present invention, technical scheme and advantage clearly understand, below in conjunction with drawings and Examples, the present invention is further elaborated.Should be appreciated that specific embodiment described herein only in order to explain the present invention, be not intended to limit the present invention.
embodiment 1
As shown in Figure 1, in the present embodiment, the storage experimental system based on disk array virtualization comprises client 100, server end 200 and the network storage equipment 300.
Client 100 comprises multiple groups of clients, for storing experimental implementation, business checking and sending configuration data storage resource request and configuration data load request to server end 200, described configuration data derives from client 100 and stores experiment, for performing storage operational order.
The application configuration data storage resource request that server end 200 sends for the treatment of described client 100 and configuration data load request, configuration data storage resource request is that request is stored into virtual disk array corresponding virtualized storage configuration data from client, configuration data load request is that request to be loaded into configuration data the network storage equipment from virtual disk array and to perform, wherein, described server end 200 comprises a virtualized storage 210.
Described virtualized storage 210 comprises multiple virtualized disk array (disk group), each virtualized disk array correspond to the part disk in the described network storage equipment, each virtualized disk array and described client 100 one_to_one corresponding, a client 100 correspond to a virtual disk array, what each client 100 operated is corresponding virtual disk array, the operational order of corresponding client 100 that what each virtual disk array stored is, described operational order and configuration data, configuration data in described virtual disk array is loaded into the described network storage equipment 300 according to the instruction of client 100 by described server end 200, after processing configuration data loading, the configuration data result that the described network storage equipment 300 returns is fed back to described client 100 by described server end 200, verify to make client 100 finishing service.
Above-mentioned disk array (redundantarraysofindependentdisks, RAID), has the meaning of " array with redundant ability that independent disk is formed ".Disk array is by the more cheap disk of a lot of price, is combined into the disk group that a capacity is huge, utilizes indivedual disk to provide data to produce the whole disk system usefulness of addition effect promoting.Utilize this technology, data are cut into many sections, leave in respectively on each hard disk.Disk array can also utilize the idea of parity check (ParityCheck), in array during any one hard disk failure, still can sense data, when data reconstruction, by data as calculated after again insert in new hard disk.
As shown in Figure 2, virtualized storage 210 comprises multiple disk array, described disk array is virtualized, in the present embodiment, build virtualized disk array, also virtualized disk group is namely built, concrete, by sending inquiry disk command to the network storage equipment 300, obtain the True Data of disk, disk on the described network storage equipment 300 is laterally longitudinally regularly arranged, every block disk comprises a logical place attribute, as (0, 0) disk being in the first row first row is represented, (1, 2) expression is in the tertial disk of the second row, according to this position attribution relation of disk on the network storage equipment 300, in virtualized storage 210, set up virtualized disk array is formed corresponding with the form of list structure with the disk relation on the network storage equipment 300, thus set up virtualized disk array.
The network storage equipment 300 is for performing configuration data and returning configuration data result to client 100 by server end 200.
Described client 100 is also for receiving described configuration data result.
Server end 200 also comprises client-requested processing layer 220, and described client-requested processing layer 220 connects described client 100 and described virtualized storage 210 respectively; Described client-requested processing layer 220 is for the treatment of from the configuration data storage resource request of client 100 and configuration data load request.
Server end 200 also comprises hardware device interbedded formation 230, and it connects described virtualized storage 210 and the described network storage equipment 300 respectively; Described hardware device interbedded formation 230 accepts the request that described virtualized storage 210 sends, safeguard the mapping of the configuration data in described virtual disk array to the described network storage equipment 300, processing configuration Data import, wherein, in the process that configuration data loads, different student client 100 can loaded in parallel.
Virtual disk array state in virtualized storage 210 is determined by a series of preorder orders that described disk array is corresponding, and this preorder order is sent by the client 100 that described virtual disk array is corresponding.
Server end 200 all adopts the Socket communication technology to carry out growing being connected with client 100, server end 200 with the network storage equipment 300, whether so-called long connection refers to no matter use after setting up Socket connects all keep connection status, is convenient to the connection status of complete monitoring client 100 like this.When after client 100 successful log to server end 200, server end 200 newly can be set up a thread and process separately request from client 100, as application equipment loading etc.
The embodiment of the present invention 1 provides a kind of storage experimental system based on disk array virtualization, by setting up virtualized memory device to store experiment at server end, solve the low problem of plant factor that the exclusive network storage equipment brings, improve multiple student and do the concurrency storing experiment simultaneously, shorten experimental period and experimental Response time, substantially increase plant factor.
Should be understood that the size of the sequence number of each step in above-described embodiment and do not mean that the priority of execution sequence, the execution sequence of each process should be determined with its function and internal logic, and should not form any restriction to the implementation process of the embodiment of the present invention.
embodiment 2
The embodiment of the present invention 2 provides a kind of method realizing testing based on the storage of disk array virtualization.
Fig. 3 shows the virtualized method step storing experiment of the present invention, as follows:
S101: disk association is carried out to the disk array of the virtualized storage of server end, namely described disk association determines the incidence relation of disk group in each virtual disk array and the described network storage equipment, the disk group associated by the disk array of described virtualized storage and client one_to_one corresponding.
Step S101 completed before storage experiment starts, the virtual disk array of described virtualized storage is created and carries out disk and associate, disk group associated by described virtual disk array and client one_to_one corresponding, thus, after client logs in, the storage space that client carries out distributing when storing experiment is the virtual disk array (disk group in the network storage equipment that also associate) corresponding with it.
S102: client completes and stores experiment, and client sends configuration data storage resource request and configuration data load request.
Wherein, first described client applies for that configuration data preserves request, then applies for configuration data load request.
S103: server-side processes client-requested, the configuration data storing experiment is saved in the virtual disk array of the virtualized storage of server end, and the configuration data preserved in the virtual disk array of virtualized storage is loaded into the described network storage equipment;
Wherein, the client-requested processing layer being positioned at server end is for the treatment of from the configuration data storage resource request of client and configuration data load request; The hardware device interbedded formation being positioned at server end accepts the request of described virtualized storage transmission, safeguards the mapping of the configuration data in described virtual disk array to the described network storage equipment, processing configuration Data import.
Configuration data when virtual disk array is loaded into the described network storage equipment from described virtualized storage, supports loaded in parallel between client.
S104: the network storage equipment performs configuration data, and configuration data result is fed back to client by server end, client finishing service is verified.
Preferably, the state of described virtual disk array is determined by a series of preorder orders that described virtual disk array is corresponding, and this preorder order is sent by the client that described virtual disk array is corresponding.
Preferably, described server end all adopts the Socket communication technology to carry out growing being connected with described client, described server end with the described network storage equipment, whether so-called long connection refers to no matter use after setting up Socket connects all keep connection status, is convenient to the connection status of complete monitoring client like this.When after client successful log to server end, server end newly can be set up a thread and process separately request from client, as application equipment loading etc.
A kind of storage experimental technique based on disk array virtualization that the embodiment of the present invention 2 provides, the method is mainly through setting up virtualized storage at server end, multiple virtual disk array is created in virtualized storage, the grouping of limited network storage equipment resource is utilized (disk stripping), solve the problem that student experimenting is waited in line, substantially increase plant factor and response speed simultaneously, and ensure that the authenticity of operation in device authentication link.The present invention improves memory device utilization factor and conventional efficient fully.
The foregoing is only preferred embodiment of the present invention, not in order to limit the present invention, all any amendments done within the spirit and principles in the present invention, equivalent replacement and improvement etc., all should be included within protection scope of the present invention.

Claims (9)

1. based on a storage experimental system for disk array virtualization, it is characterized in that, described system comprises client, server end and the network storage equipment, wherein:
Described client is for storing experimental implementation, business checking and sending configuration data storage resource request and configuration data load request to server end, and described configuration data derives from client and stores experiment, for performing storage operational order;
The application configuration data storage resource request that described server end sends for the treatment of described client and configuration data load request, configuration data storage resource request is that request is stored into virtual disk array corresponding virtualized storage configuration data from client, configuration data load request is that request to be loaded into configuration data the network storage equipment from virtual disk array and to perform, wherein, described server end comprises a virtualized storage;
Described virtualized storage comprises multiple virtualized disk array, each virtualized disk array correspond to the part disk in the described network storage equipment, each virtualized disk array and described client one_to_one corresponding, a client correspond to a virtual disk array, each client operation be corresponding virtual disk array, the operational order of corresponding client that what each virtual disk array stored is, described operational order is configuration data, configuration data in described virtual disk array is loaded into the described network storage equipment according to the instruction of client by described server end, after processing configuration data loading, the configuration data result that the described network storage equipment returns by described server end feeds back to described client, verify to make client finishing service,
The described network storage equipment is for performing configuration data and returning configuration data result to client by server end;
Described client is also for receiving described configuration data result.
2., as claimed in claim 1 based on the storage experimental system of disk array virtualization, it is characterized in that, described server end also comprises client-requested processing layer, and described client-requested processing layer connects described client and described virtualized storage respectively; Described client-requested processing layer is for the treatment of from the configuration data storage resource request of client and configuration data load request.
3., as claimed in claim 1 based on the storage experimental system of disk array virtualization, it is characterized in that, described server end also comprises hardware device interbedded formation, and it connects described virtualized storage and the described network storage equipment respectively; Described hardware device interbedded formation accepts the request that described virtualized storage sends, safeguard the mapping of the configuration data in described virtual disk array to the described network storage equipment, processing configuration Data import, wherein, described configuration data, when loading, supports different clients loaded in parallel.
4. as claimed in claim 1 based on the storage experimental system of disk array virtualization, it is characterized in that, virtual disk array state in described virtualized storage is determined by a series of preorder orders that described virtual disk array is corresponding, and described a series of preorder order is sent by the client that described virtual disk array is corresponding.
5., as claimed in claim 1 based on the storage experimental system of disk array virtualization, it is characterized in that, described server end all adopts the Socket communication technology to carry out growing being connected with described client, described server end with the described network storage equipment.
6., based on a storage experimental technique for disk array virtualization, it is characterized in that, comprise the following steps:
Disk association is carried out to the disk array of the virtualized storage of server end, namely described disk association determines the incidence relation of disk group in each virtual disk array and the described network storage equipment, the disk group associated by the disk array of described virtualized storage and client one_to_one corresponding;
Client completes and stores experiment, and client sends configuration data storage resource request and configuration data load request;
Server-side processes client-requested, the configuration data storing experiment is saved in the virtual disk array of the virtualized storage of server end, and the configuration data preserved in the virtual disk array of virtualized storage is loaded into the described network storage equipment;
The network storage equipment performs configuration data, and configuration data result is fed back to client by server end, and client finishing service is verified.
7. method as claimed in claim 6, is characterized in that, described server end by the process of client-requested processing layer from the configuration data storage resource request of client and configuration data load request; Described server end accepts the request of described virtualized storage transmission by hardware device interbedded formation, safeguard the mapping of the configuration data corresponding disk group in the described network storage equipment in described virtual disk array, processing configuration Data import, when configuration data is loaded into the described network storage equipment from described virtualized storage, loaded in parallel between different clients.
8. method as claimed in claim 6, it is characterized in that, the state of described virtual disk array is determined by a series of preorder orders that described virtual disk array is corresponding, and described a series of preorder order is sent by the client that described virtual disk array is corresponding.
9. method as claimed in claim 6, it is characterized in that, described server end all adopts the Socket communication technology to carry out growing being connected with described client, described server end with the described network storage equipment.
CN201510669450.4A 2015-10-13 2015-10-13 Storage experimental system based on disk array virtualization and method Active CN105242883B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510669450.4A CN105242883B (en) 2015-10-13 2015-10-13 Storage experimental system based on disk array virtualization and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510669450.4A CN105242883B (en) 2015-10-13 2015-10-13 Storage experimental system based on disk array virtualization and method

Publications (2)

Publication Number Publication Date
CN105242883A true CN105242883A (en) 2016-01-13
CN105242883B CN105242883B (en) 2016-09-07

Family

ID=55040546

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510669450.4A Active CN105242883B (en) 2015-10-13 2015-10-13 Storage experimental system based on disk array virtualization and method

Country Status (1)

Country Link
CN (1) CN105242883B (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7437530B1 (en) * 2003-04-24 2008-10-14 Network Appliance, Inc. System and method for mapping file block numbers to logical block addresses
US20090094251A1 (en) * 2007-10-09 2009-04-09 Gladwin S Christopher Virtualized data storage vaults on a dispersed data storage network
CN101827121A (en) * 2010-03-12 2010-09-08 成都市华为赛门铁克科技有限公司 Method, service end and system for creating files in RAID (Redundant Array of Independent Disk)

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7437530B1 (en) * 2003-04-24 2008-10-14 Network Appliance, Inc. System and method for mapping file block numbers to logical block addresses
US20090094251A1 (en) * 2007-10-09 2009-04-09 Gladwin S Christopher Virtualized data storage vaults on a dispersed data storage network
CN101827121A (en) * 2010-03-12 2010-09-08 成都市华为赛门铁克科技有限公司 Method, service end and system for creating files in RAID (Redundant Array of Independent Disk)

Also Published As

Publication number Publication date
CN105242883B (en) 2016-09-07

Similar Documents

Publication Publication Date Title
US11113161B2 (en) Local storage clustering for redundancy coded data storage system
CN106406896B (en) Block chain block building method based on parallel Pipeline technology
CN108810115B (en) Load balancing method and device suitable for distributed database and server
CN103929500A (en) Method for data fragmentation of distributed storage system
CN104166606A (en) File backup method and main storage device
WO2020256796A1 (en) Efficient non-uniform object processing
CN105025053A (en) Distributed file upload method based on cloud storage technology and system
CN103870338A (en) Distributive parallel computing platform and method based on CPU (central processing unit) core management
CN104270409B (en) Centrally stored method is efficiently utilized in a kind of cloud platform
US10430336B2 (en) Lock-free raid implementation in multi-queue architecture
CN105138281B (en) A kind of sharing method and device of physical disk
Zhang et al. Smarth: Enabling multi-pipeline data transfer in hdfs
US10346066B2 (en) Efficient erasure coding of large data objects
CN104283959A (en) Performance-grading-based storage mechanism suitable for cloud platform
US8595192B1 (en) Systems and methods for providing high availability to instance-bound databases
CN103049317A (en) Highly-concurrent data fast write system and method based on queues in cloud environment
CN103885829A (en) Virtual machine cross-data-center dynamic migration optimization method based on statistics
CN106960011A (en) Metadata of distributed type file system management system and method
CN107704310A (en) A kind of method, apparatus and equipment for realizing container cluster management
CN104144202A (en) Hadoop distributed file system access method, system and device
CN102820998B (en) Realize the dual computer fault-tolerant service system towards office application and date storage method thereof
US9720818B2 (en) Scalable, distributed, fault-tolerant test framework
CN113051102B (en) File backup method, device, system, storage medium and computer equipment
CN104281636A (en) Concurrent distributed processing method for mass report data
EP3349416B1 (en) Relationship chain processing method and system, and storage medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20211029

Address after: 518000 room 1201, Sangda science and technology building, Yuehai street, Nanshan District, Shenzhen, Guangdong

Patentee after: Zhihuirong cloud information technology (Shenzhen) Co.,Ltd.

Address before: 518067 Room 201, building B, Chuangye No.1, Gongye 6th Road, Nanshan District, Shenzhen City, Guangdong Province

Patentee before: SHENZHEN XUNFANG TECHNOLOGY Co.,Ltd.