WO2011162744A1

WO2011162744A1 - Methods and systems for planning application deployment

Info

Publication number: WO2011162744A1
Application number: PCT/US2010/039432
Authority: WO
Inventors: Jonathan David Gibson; Matthew A. Stuempfle
Original assignee: Hewlett-Packard Development Company, L.P.
Priority date: 2010-06-22
Filing date: 2010-06-22
Publication date: 2011-12-29
Also published as: EP2585910B1; CN102959506B; EP2585910A1; EP2585910A4; US9858068B2; US20130097597A1; CN102959506A

Abstract

According to one example, there is provided a method of deploying applications in a computer system. The method comprises obtaining, for each of a plurality of computer applications, a set of application characteristics, assigning, based on the obtained characteristics, each of the plurality of applications to one of a set of predetermined application models, and determining, based in part on the obtained characteristics and in part on application model compatibility data, a set of hardware characteristics, a virtual server distribution plan, and an application distribution plan.

Description

METHODS AND SYSTEMS FOR PLANNING APPLICATION DEPLOYMENT

BACKGROUND

[0001 ] Many modern businesses and organizations reiy heavily on information technology (IT) to provide computer-based tools and services to enable them and their customers to operate efficiently. The tools and services are typically provided by a multitude of different software applications which typically run on a variety of computing hardware, such as computer servers, networking equipment, storage devices, and the like. For reasons of efficiency and ease of management, this computing hardware is increasingly being consolidated in specialized data centers.

[0002] Software applications may be conveniently arranged to run in a virtualized environment through use of software virtuaiization applications, such as virtual machines. In this way, a single computer server may effectively concurrently run multiple computer operating systems instances (or virtual images) and concurrently run different applications on each of the virtual images.

[0003] When deciding on what computing hardware to provision in a data center often little regard is given to the nature of the software applications that are to be run. Accordingly, poorly planned data centers may be provisioned with much more computing hardware than is actually required to run a set of software applications. Not only is such over provisioning costly, it may also lead to the software applications being deployed on the computing hardware in an inefficient manner. Inefficient deployment may lead to so-called server or virtual sprawl, the consequences of which may include significant increases in power, cooling, and space requirements.

BRIEF DESCRIPTION

[0004] Examples of the invention will now be described, by way of non- limiting example only, with reference to the accompanying drawings, in which: [0005] Figure 1 is a simplified biock diagram illustrating a portion of a data center;

[0008] Figure 2 is a simplified illustration of an example deployment of operating systems and software applications in a computer server;

[0007] Figure 3 is a simplified block diagram illustrating a virtualization assessment engine 302 according to an example of the present invention;

[0008] Figure 4 is a simplified flow diagram outlining a method of operating a virtualization assessment engine according to an example of the present invention;

[0009] Figure 5 is a simplified block diagram illustrating a virtualization assessment engine according to an example of the present invention;

[00010] Figure 6 is a simplified flow diagram outlining a method of operating a virtualization assessment engine according to an example of the present invention;

[0001 1 ] Figure 7 is an illustration of a virtual image and application deployment plan according to one example; and

[00012] Figure 8 is a simplified biock diagram illustrating an implementation of a virtualization assessment engine according to one example of the present invention,

DETAILED DESCRIPTION

[00013] Various embodiments will be described below with reference to various examples.

[00014] Increasingly, enterprise software applications are being deployed in virtualized environments on powerful computing hardware provisioned in specialized facilities such as data centers. Figure 1 shows a simplified block diagram illustrating a portion of a data center 100. The data center 100 comprises a number of computer servers 102a to 102n connected to a data center backbone network 104. Those skilled in the art wi!i appreciate that, for clarity, not all elements of a typical data center are shown.

[00015] Each of the servers 102a to 102n runs a virtualization application, such as VMWare, Inc. vSphere application, which enables instances, or virtual images, of different operating systems to concurrently execute on each of the servers. For example, server 102a may execute a virtua!ization application that enables the concurrent execution of instances of a Microsoft, Linux, and Solaris operating system, and further enables the concurrently execution of different applications on each of the different operating systems instances.

[00016] As shown in Figure 2, a virtualization application 202 executes and manages the virtualized execution of three different operating system instances 204, 208, and 208. On the first operating system instance 204 are executed applications 210a, 210b, and 210c. On the second operating system instance 206 are executed applications 212a and 212b. On the third operating system instance 208 are executed applications 214a to 214d.

[00017] Currently, system architects wishing to deploy a set of applications have typically identified a set of unused computing hardware, for example in a data center, and have determined how the set of applications would be deployed on the computing hardware based largely on their personal knowledge and experience. However, it is common for system architects to substantially over- specify hardware requirements to avoid the risk of potential server overload.

[00018] Furthermore, it is common for system architects to deploy the applications on the hardware in a somewhat cautious manner by only lightly loading each server with applications to avoid the risk of server overload. However, such an approach may lead to so-called virtualization or server sprawl in which a large number of physical servers run at low utilization. This can lead to significant inefficiencies with respect to data center power, cooling systems, memory, storage, and physical space. [00019] Referring now to Figure 3, there is shown a virtualization assessment engine 302 according to an example of the present invention. Methods of operating the virtualization assessment engine 302 according to various examples are described below with further reference to the flow diagrams of Figure 4 and Figure 6.

[00020] In accordance with one or more examples, the virtualization assessment engine 302 determines or generates the characteristics of a set of computing hardware that may be used to execute the set of target applications, and additionally determines an efficient manner of distributing or deploying the set of target applications of the determined hardware.

[00021 ] in one example, the virtualization assessment engine 302 obtains (402) data 306a to 306n relating to a set of target applications that are desired to be run in a data center or other computing facility. The virtualization assessment engine 302 processes (404) the obtained data and generates (406) the characteristics of a set of hardware requirements 304a to 304n that may be used to execute the target applications. The virtualization assessment engine 302 then generates (408) a deployment plan 308 for appropriately distributing those applications on the determined hardware. The deployment plan 308 comprises a plan 310 for distributing operating system virtual images across the determined set computing hardware and a plan 312 for distributing, deploying, or stacking, the target applications between the different operating system virtual instances.

[00022] The data 306 relating to the set of applications may, for example, be obtained automatically through use of software agents, software management tools, manually, or in any other appropriate manner. The data 306 may include technical characteristics or requirements, including, for example, the operating system on which the application is designed to run, the amount of memory required, the amount of storage required, etc. The data 306 may additionally comprise business requirements data. The business requirements data may, for example, define business-imposed restrictions or requirements. The business requirements may, for example, be obtained by a data center or system administrator or architect, or in any other appropriate manner. [00023] Complex interactions may exist between different software applications. For example, one software application may, for business or security reasons, be the only application allowed to run on a particular physical computer server to ensure that business imposed security requirements are met. Furthermore, such an application may be required to be installed on a standalone virtualization application. By way of further example, an application may be dependent on a specific operating system binary library, may require application component level clustering with physical hardware divergence (for example where physical hardware servers are required to be in separate data center enclosures) for redundancy, and so on.

[00024] Making sense of all of the different parameters and factors is a particularly challenging and complex task.

[00025] Referring now to Figure 5, there is shown a system 500 in which the virtualization assessment engine 302 is shown in greater detail, according to an example. Further reference is made to Figure 6.

[00028] An application model matcher module 502 obtains (602) a set 504a to 504n of application attributes of a set of target applications which it is desired to install and execute in a virtualized manner. In the present example, the application attributes include both technical 508 and non-technical 508 application attributes. In other examples, the application attributes 504a to 504n may include attributes other than both technical and non-technical attributes.

[00027] The non-technical attributes may include, for example, functional requirements that may impact the placement or cohabitation of an application in a virtual environment or on physical hardware. For example, the non-technical attributes may define, from a functional or business aspect whether an application is allowed to cohabit with other applications in the same virtual machine, or even on the same physical hardware. This may be the case, for example, for an application that has security requirements in which the application owner does not wish for the application to share physical or virtual resources with any other application. [00028] In some examples the set of obtained attributes 504a to 504n include attribute prioritizations or weightings. In other examples, weightings may be allocated once the attributes have been obtained, either manually by a user or automatically by applying predetermined weightings. The weightings may, for example, be used to indicate relative importance of different characteristics.

[00029] Example application attributes are shown below in Tables 1 and 2.

TABLE 1 - Example application attributes

TABLE 2 - Example application attributes

[00030] In some examples the application attributes may be defined using a markup language such as the extensible markup language (XML).

[00031 ] The system 500 comprises an application model store 510 in which is stored a set of predetermined application models.

[00032] Each application model may be defined through analysis of different software applications that may be desired to be run in a data center. Such analysis may suitably be performed manually by a system administrator or architect or automatically by an application analysis module or tool (not shown). Each application model aims to provide a unique, or substantially unique, set of technical and/or non-technical attributes that identify key application characteristics. Some application models may have only technical attributes, whereas other application models may have both technical and non-technical attributes.

[00033] Example application models are shown below in Tables 3 and 4.

TABLE 3 - Example application model

TABLE 4 ^---- Example application model

[00034] In some examples the applications models may be defined using a mark-up language such as XML. Example application attributes are shown below in Tables 1 and 2.

[00035] At 604 the application model matcher 502 attempts to match or to assign each of the target applications for which application attributes 504 are obtained to an application model stored in the application model store 510.

[00036] In one example the matching or assignment process may be performed by searching for an application model that exactly matches each of the obtained application attributes 504 for a given application. Sn other examples, the matching process may, for example, be performed by searching for an application model that best matches, or substantially matches, the obtained application attributes, or matches with a predetermined degree of similarity at least some of the attributes. For example, some or all of the application attributes may have associated weightings defining a relative importance level or acceptable similarity level. The analysis process may use suitable XML parsing techniques in some examples, where appropriate.

[00037] Once each of the application attributes for each target application have been matched or assigned to an application model the results are passed to a virtual machine image planning module 512.

[00038] The virtual machine image planning module 512 obtains application model compatibility data stored in an application model compatibility data store 514. In some examples the application model compatibility data may be stored together with the application model data.

[00039] The application model compatibility data defines which application models are compatible with which other application models in a virtualized environment and, by inference, defines which application models are incompatible with which other application models. An example is shown in Table 5 below.

TABLE 5 - Example application mode compatibility

[00040] Compatibility of one application model with another may be determined by analysis of the technical and non-technical application attributes. The analysis may be performed, for example, manually by a system administrator or system architect, through use of application analysis tools, process monitors, or in any suitable manner. Example application attributes are shown below in Tables 1 and 2.

[00041 ] For instance, an application model requiring a Linux operating system may be determined to be incompatible with an application requiring a Windows operating system. Similarly, an application model in which application component clustering is required may be determined to be incompatible with an application model in which application clustering is not required.

[00042] The virtual machine image planning module 512 determines (608), using the application model compatibility data, which applications are compatible with each other and thus which applications may cohabit with which other applications in a given virtual machine image or on the same physical hardware. Applications for which their corresponding application models may be determined as being non-compatible are determined as not being able to cohabit with each other. For example, applications requiring the Linux system may be determined as not being able to cohabit in a virtual machine image of the Windows operating system. By way of further example, applications having attributes defining that server sharing is not allowed would not be allowed to cohabit with other applications, even with applications requiring the same operating system.

[00043] The virtual image planning module 512 determines the minimum number of virtual machine instances of each operating system necessary to execute the set of target applications, taking into account the application compatibility data, and details which applications should and should not be collocated in the same operating system instance. The virtual image planning module 512 also determines appropriate configuration parameters for each virtual image. However, this initial determination is made without any regard to required hardware resources. As described below, a greater number of virtual machine images may be required depending on the determined hardware characteristics. [00044] The determined details are passed to a virtual machine image deployment and application deployment planning module 516.

[00045] One particular advantage of having a set of application models and predetermined compatibility between those models is that it reduces the task of determining whether different applications are compatible with each other to the relatively straightforward operation of pattern matching key characteristics of a target application to characteristics of a set of application models.

[00046] In order to determine an efficient deployment plan a vast number of factors relating to the software applications to be executed, the operating systems required, the virtual images, the virtualization applications, and the physical hardware may need to be taken into consideration. The factors may include both technical or physical factors as well as business factors.

[00047] Hardware technical factors may, for example, include: processing power; multitasking capabilities; memory capacity; storage capacity; and network bandwidth. Software application technical factors may include, for example: memory requirements; networking requirements; storage requirements; security requirements; redundancy requirements; and processing power requirements.

[00048] The virtual machine deployment and application deployment planning module 516 obtains (610) virtual machine image attributes 520 which define attributes of available target virtual machine images. The virtual machine image attributes 520 may include details of minimum hardware resources required, number of execution threads possible, and other appropriate characteristics. The virtual machine attributes 520 may be obtained, for example, by a system administrator or system architect, through data supplied by virtual machine developers or suppliers, through software monitoring applications, software agents, or in any other suitable manner.

[00049] The virtual machine deployment and application deployment planning module 516 obtains (612) deployment plan preference data stored in a deployment plan preference data store 524. The deployment plan preference data may be set by a system administrator or system architect, or a default predetermined set of deployment plan preferences may be defined. The deployment plan preferences determine preferences that are to be taken into account by the module 518, as described further below.

[00050] The preferences may include hardware preferences, such as preferred processing characteristics, preferred hardware manufacturers, cost ranges, server type, and the like. The preferences may also define specific limitations or thresholds for the use of hardware by the virtual images. In one example the preferences may define a maximum amount of CPU utilization for a hardware device. Use of the plan preferences enables a final deployment or stacking plan to be tailored to specific system administrator or system architects requirements.

[00051 ] The deployment plan preferences are taken into account, along with the VM image attributes (520), so that the VM image deployment and application deployment planning module (516) produces a set of hardware characteristics 518, a virtual machine deployment plan (526) and an application deployment or stackabiiity plan (528).

[00052] At 814, the module 516 determines an initial virtual machine and application deployment plan by analyzing the characteristics of each of the target applications in turn and assigning each application to a virtual image. The assignment of applications to virtual images take into account the application characteristics, such as the resources required by other applications assigned to the same virtual image, as well as application compatibility data. If the virtual machine deployment and application deployment planning module 516 determines that the virtual machine image resources would be exceeded by adding the application to the virtual image, a different virtual image is sought on which to place the application. If a suitable virtual image is found, the application is assigned to the found virtual image. If no suitable virtual image is found, a new virtual image is allocated, and the application is assigned to the new virtual image. In one example the resources allocated to a virtual image may be based on hardware preferences stored in the preference store 524. In another example, the resources allocated to a virtual image may be based on a default set of hardware characteristics.

[00053] At 818 the virtual image deployment and application deployment planning module 516 determines, based on the initial virtual machine deployment plan, a set of minimum hardware attributes 518 suitable for executing the target applications in a virtualized manner. The determination may be made, for instance, by determining the minimum requirements for processing power, storage, memory, network capabilities, etc. as determined from the application attributes.

[00054] In a further example the hardware attributes determined by the module 516 may define a set of commercially available hardware, for example from a hardware library or database (not shown), by selecting a set of physical hardware that collectively have hardware attributes that meet the determined minimum hardware requirements. The selection process may, in some examples, include pricing information and other technical and non-technical attributes.

[00055] Depending on the set of physical hardware determined at 616, and depending on the characteristics thereof, the module 618 may need to adjust the initial virtual machine and application deployment plan to produce a final virtual machine image and application deployment plan. For instance, if a cost limit is included in the hardware preference data the module 516 may determine that two smaller and cheaper servers are required, rather than one larger, more expensive server. Sn this case, one or more additional virtual machine image may be required and the application deployment plan would need adjusting to take into account the additional virtual machine image or images.

[00056] Using the obtained information the virtual machine deployment and application deployment planning module 516 determines (614) a final virtual image deployment plan 526 and a final application deployment or stacking plan 528. The virtual image deployment plan defines the type and number of virtual images that are determined to be suitable for hosting or executing the set of applications. The virtual image deployment plan 526 additionally defines the way in which the defined virtuai images should be installed on the determined physical hardware. The application deployment or stacking plan 528 defines which of the target applications should be installed on which of the virtuai images,

[00057] In some examples the virtuai machine image deployment and application deployment planning module 516 calculates, for different combinations of target hardware and target applications, different virtuai machine deployment plans 526 and application stacking plans 528 using appropriate ones of the application and virtual machine attributes.

[00058] In one example the module 516 determines multiple different combinations of virtuai machines and application deployments and ranks the different combinations based on one or more different parameters. The module 516 may rank the different combinations based on different criteria, including, for example, the smallest number of virtual machine images, the smallest number of physical servers, the highest number of applications per virtuai machine image, the lower hardware cost, etc. The module 516 may automatically select one of the deployment plans as being the preferred deployment plan based on some predetermined preferences, such as preferences stored in the preference data store 524.

[00059] In a further example a list of different deployment plans may be presented to a system administrator or architect for manual selection of a preferred deployment plan and preferred hardware attributes. The presentation may be made, for example, via a visual display unit (not shown) associated with the virtualization assessment engine 302.

[00060] The determined virtual machine and application deployment plans 526 and 528, as well as the determined hardware attributes 518, may be output in the form of appropriate metadata, for example in an XML format. The virtuai machine and application deployment plans 526 and 528 may be used by virtualization management applications to automatically configure the target hardware with appropriate virtuai machine images, and appropriately distribute the target applications in accordance with the selected virtuai machine and application deployment plan. The determined hardware attributes 518 may be used by a procurement application for ordering the determined hardware.

[00081 ] An example illustration of a virtual image and appiication deployment plan is shown in Figure 7. A number of physical servers 702a to 702d are shown, each running a virtualization application 704a to 704d respectively. Server 702a runs a single Windows virtual image 706a on which run a number of Windows applications 708a. Server 702b runs a Windows virtual image 706b on which run Windows applications 708b, and a Linux virtual image 708b' on which run Linux applications 708b'. Server 702c runs a Windows virtual image 706c on which run Windows applications 708c, and a Solaris virtual image 706c' on which run Solaris applications 708c'. Finally, a server 702d runs a Windows virtual image 706d on which runs a single Windows application 708d.

[00082] In a yet further example the appiication model matcher module 502 is configured to create a new application model when it determined that the set of application attributes 504 for an appiication do not suitably match any application models currently stored in the application model store 510. In one example if a set of appiication attributes only partially match an existing application model, a new appiication model may be created by determining the closest matching application model and copying part of the determined closest matching application model and modifying it to create new model attributes for the non- matching elements. The newly generated application model may be stored in the application model store 510 for future use. In one example, an alert may be triggered when a new application model is created, for example to allow a system administrator or architect to update or verify the newly created appiication model and to add, if required, appiication model compatibility data to the appiication compatibility data store 514.

[00083] Referring now to Figure 8 there is shown a block diagram of an example implementation of the virtualization assessment engine 302. The virtualization assessment engine 302 comprises a microprocessor, control logic, or micro controller 802 for executing machine readable instructions stored in a memory 804. The machine readable or computer executable instructions may, when executed by the processor 802, perform method steps as described above as a computer implemented method. Input and output operations may be handled by an I/O module 808. The processor 802, memory 804, and I/O interface 808 are coupled or are in communication via a bus 808.

[00064] In a further example a carrier carrying computer-implementable instructions is provided that, when interpreted by a computer, cause the computer to perform a method in accordance with any of the above-described examples.

[00065] It will be appreciated that examples can be realized in the form of hardware, software or a combination of hardware and software. Any such software may be stored in the form of tangible volatile or non-volatile storage such as, for example, a storage device like a ROM, whether erasable or rewritable or not, or in the form of memory such as, for example, RAM, memory chips, device or integrated circuits or on an optically or magnetically readable medium such as, for example, a CD, DVD, magnetic disk or magnetic tape.

[00066] It will be appreciated that the storage devices and storage media are examples of machine-readable storage that are suitable for storing a program or programs that, when executed, implement embodiments of the present invention. Accordingly, examples may provide a program comprising code for implementing a system or method as described herein. Examples may additionally provide a machine readable storage storing such a program. Still further, examples may be conveyed electronically via any medium such as a communication signal carried over a wired or wireless connection and examples suitably encompass the same.

[00067] All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and/or ail of the steps of any method or process so disclosed, may be combined in any combination, except combinations where at least some of such features and/or steps are mutually exclusive.

[00068] Each feature disclosed in this specification (including any accompanying claims, abstract and drawings), may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise. Thus, unless expressly stated otherwise, each feature disciosed is one example only of a generic series of equivalent or similar features.

Claims

CLAIMS 1 . A method of planning application deployment in a computer system, comprising:

obtaining, for each of a plurality of computer applications, a set of application characteristics;

assigning, based on the obtained characteristics, each of the plurality of applications to one of a set of predetermined application models; and

determining, based in part on the obtained characteristics and in part on application model compatibility data, a set of hardware characteristics, a virtual server distribution plan, and an application distribution plan.

2. The method of claim 1 , wherein the step of determining comprises:

determining an initial virtual server distribution plan;

determining a set of hardware characteristics;

revising the initial virtual server distribution plan in accordance with the determined set of hardware characteristics; and

determining an application distribution plan.

3. The method of claim 1 , wherein the determined set of hardware characteristics define characteristics of a set of computing hardware suitable for executing the set of applications, wherein the determined virtual distribution plan defines a number and type of virtual servers to be deployed on each of the defined computing hardware, and wherein the application distribution plan defines which of the set of applications are to be deployed on which of the virtual servers.

4. The method of claim 1 , wherein the step of determining a revised virtual server distribution plan includes determining the characteristics and number of virtual servers suitable for executing the set of applications on the determined computing hardware.

5. The method of claim 1 , wherein the step of assigning further comprises, where it is determined that an application does not suitably match any of the predetermined application models, generating a new application model based on characteristics of the application.

6. The method of claim 5, wherein the step of generating a new application model comprises determining the closest matching application model and generating a new application model based on the determined closest matching application model.

7. The method of claim 1 , wherein the step of determining a virtual server deployment plan and an application deployment plan further comprises:

determining a plurality of different sets of hardware characteristics, virtual server deployment plans, and application deployment plans, each of the plurality of different hardware sets and deployment plans determined based on different combinations of application characteristics and obtained preference data; and selecting one of the plurality of determined hardware sets and deployment plans based on the obtained preferences.

8. A system, comprising a processor, a memory in communication with the processor, and computer executable instructions stored in the memory and executable on the processor to:

obtain a set of characteristics for each of a plurality of applications;

match, using the obtained characteristics, each of the applications to a predetermined application model;

generate an initial virtual server distribution plan;

generate a set of hardware characteristics; and

generate a revised virtual server distribution plan in accordance with the generated set of hardware characteristics.

9. The system of claim 8, wherein the computer executable instructions further include instructions to:

generate a list of computing hardware on which the applications may be deployed.

10. The system of claim 8, wherein the computer executable instructions further include instructions to:

generate a virtual server distribution plan detailing the type and number of virtual servers suitable for executing the set of applications and for detailing on which ones of the determined computing hardware each virtual server is to be deployed.

1 1 . The system of claim 10, wherein the computer executable instructions further include instructions to:

generate an application deployment plan detailing on which ones of the virtual servers each of the applications is to be deployed.

12. The system of claim 8, wherein the computer executable instructions further include instructions to:

where it is determined that an application does not match any of the application models, to generate a new application model based on characteristics of the application, and to store the generated application model in an application model data store.

13. The system of claim 8, wherein the computer executable instructions to generate the distribution plans further include instructions to:

generate a plurality of sets of hardware characteristics, virtual server and application distribution plans; and

select one of the sets of hardware characteristics and associated generated distribution plans in accordance with obtained preference data.

14. The system of claim 8, wherein the computer executable instructions further comprise instructions to:

send the generated list of computing hardware to a procurement application for ordering the generated list of computing hardware.

15. A tangible, machine-readable medium that stores machine-readable instructions executable by a processor for planning application deployment in a computer system, the tangible, machine-readable medium comprising:

machine-readable instructions that, when executed by the processor, obtain, for each of a plurality of computer applications, a set of application characteristics; machine-readable instructions that, when executed by the processor assign, based on the obtained characteristics, each of the plurality of applications to one of a set of predetermined application models;

machine-readable instructions that, when executed by the processor determine an initial virtual server distribution plan;

machine-readable instructions that, when executed by the processor determine a set of hardware characteristics;

machine-readable instructions that, when executed by the processor revise the initial virtual server distribution plan in accordance with the determined set of hardware characteristics; and

machine-readable instructions that, when executed by the processor determine an application distribution plan.