WO2017157261A1

WO2017157261A1 - Image search method, and virtual character image acquisition method and device

Info

Publication number: WO2017157261A1
Application number: PCT/CN2017/076466
Authority: WO
Inventors: 林清客; 白博; 陈茂林
Original assignee: 华为技术有限公司
Priority date: 2016-03-14
Filing date: 2017-03-13
Publication date: 2017-09-21
Also published as: CN107193816B; CN107193816A

Abstract

Provided are an image search method, and a virtual character image acquisition method and device, used for solving the problem in the prior art of large search result deviations caused by colour deviations due to illumination, shadow, visual colour difference etc. The image search method comprises: acquiring a generated virtual character image; determining the colours of various pixels of the virtual character image; respectively acquiring colour groups corresponding to the colours of the various pixels from within a colour group library, the colour group library being acquired by performing clustering on colours corresponding to various pixels within several actual character images in advance, each type corresponding to one colour group, one colour group corresponding to one basic colour, one colour group comprising a plurality of colours; using the pluralities of colours included within the colour groups of the various pixels to search within a target image database for an image matching the virtual character image.

Description

Image search method, virtual character image acquisition method and device

Technical field

The present invention relates to the field of image processing technologies, and in particular, to an image search method, a virtual person image acquisition method, and an apparatus.

Background technique

Searching by image means submitting a picture of a person who matches the submitted picture by submitting the actual picture of the person or submitting a picture that can describe the global and local features of the character. However, when the actual character picture cannot be obtained, it is necessary to make a virtual character picture and use the virtual character picture to search.

However, the generation of the virtual character is an abstract description of the character by selecting the character feature template and the clothing template. Character characteristics include height, face shape, facial features, hair style, skin color, body shape, etc., and clothing features include: tops, pants, skirts, shoes, and the like. But this requires storing a large number of clothing templates to cover as many situations as possible, wasting storage resources. In addition, a large number of templates stored may not necessarily meet the requirements. In addition, when searching for a matching picture in the database using the virtual character picture, the RGB value of each pixel of the selected virtual character can only be the color in the basic color library, but the actual scene will be due to illumination, shadow, visual chromatic aberration, etc. The situation is biased towards the color, which results in a large deviation of the search results.

Summary of the invention

An embodiment of the present invention provides an image search method, a virtual person image acquisition method, and a device, which are used to solve the problem that the clothing template existing in the prior art cannot cover all the cases and the color due to illumination, shadow, visual chromatic aberration, and the like. The problem caused by the deviation of the search results is large.

In a first aspect, an embodiment of the present invention provides an image search method, including:

Obtaining a generated virtual character image; determining a color of each pixel of the virtual character image;

Obtaining a color family corresponding to the color of each pixel from the color family library; wherein the color family library is obtained by clustering corresponding colors of each pixel in a plurality of actual character images in advance, and each class corresponds to a color family, One color family corresponds to one basic color, and one color family includes a plurality of colors; an image matching the virtual human figure image is searched in the target image database using a plurality of colors included in the color family of the respective pixels.

With the manner provided by the embodiment of the present invention, all colors in the color family are used to participate in image matching, and the colors included in the color family are obtained by clustering colors included in some actual character images, thereby reducing real people due to illumination, shadow, and The influence of visual chromatic aberration or the like on the virtual character image improves the reliability of the data, and also improves the accuracy of searching for the image matching the virtual character image in the target image database.

In a possible design, obtaining the color family library can be implemented as follows:

Obtaining images of several actual characters;

Obtaining, respectively, a color block describing a character feature included in each actual character image and a color block describing a clothing feature; the character feature is a physiological feature of the character, and the clothing feature is related information of the clothing on the character;

The clustering algorithm is used to cluster the color blocks including the character features included in each actual character image and the color information included in the color block describing the clothing feature to obtain a plurality of classes, and determine a basic color corresponding to each color included in each class;

Each of these categories includes a number of colors that make up a color family.

The clustering algorithm in the embodiment of the present invention may be a K-means algorithm, a K-Medoids algorithm, or the like.

In the above design, the color family library is obtained from the actual character image, and the accuracy of using the color in the color family library to match the image is added.

In one possible design, the color blocks describing the character features and the color information contained in the color patches describing the clothing features include: red, green, and blue RGB color components or hue, saturation, and lightness components.

In a possible design, respectively obtaining the color blocks describing the character features included in each actual character image and the color blocks describing the clothing features can be realized as follows:

Removing the background area of each actual character image separately to obtain a mask MASK image including the foreground image of each actual character image;

The color block of the character ornament included in the mask MASK image of the foreground image of the respective actual character image is removed by an edge detection algorithm to obtain a color block describing the character feature and a color block describing the clothing feature.

Clothing features include: jackets, shirts, pants, shoes, skirts, etc. The color of the garment can vary. Characters include the gender, height, face, facial features, hairstyle, skin color, expression, body shape, and so on. The padding algorithm can be a flooding fill algorithm, a boundary padding algorithm, and the like.

In one possible design, obtaining the generated virtual character image can be achieved as follows:

Receiving, by the clothing feature template and the character feature template, the indication information of the clothing adjustment of the virtual character image, where the indication information includes position information and direction information to be adjusted;

The generated virtual character image is obtained by performing a filling process on the area included in the clothing corresponding to the position information to be adjusted based on the filling algorithm.

Through the above manner, the adjustment of the garment in multiple dimensions can be realized, and when the provided clothing template cannot meet the demand, the garment can be adaptively adjusted.

In the embodiment of the present invention, the avatar image may be locked, that is, when the avatar image is in an adaptive adjustment state, after receiving the indication information of the clothing adjustment of the avatar image, the The area included in the clothing corresponding to the position information to be adjusted is subjected to filling processing to obtain a generated virtual character image. Upon receiving the indication information for the clothing feature adjustment in the virtual character image, if it is determined that the virtual character image is in the locked state, the adjustment of the clothing feature in the virtual character image is prohibited.

In the above manner, it is possible to avoid an erroneous operation that occurs when the clothing in the virtual character image is not required to be adjusted.

In a second aspect, an embodiment of the present invention provides a method for acquiring a virtual character image, including:

Receiving, by the user, the indication information of the clothing feature adjustment in the virtual character image after the avatar image and the character feature template are initially determined, the indication information includes position information and direction information to be adjusted;

In a possible design, the avatar image obtained by filling the area included in the clothing corresponding to the location information to be adjusted according to the filling algorithm to obtain the generated virtual character image can be implemented as follows:

If it is determined that the avatar image is in an adaptive adjustment state, the location information to be adjusted is based on a filling algorithm The area included in the clothing corresponding to the content is subjected to padding processing to obtain a generated virtual character image.

In one possible design, it also includes:

Upon receiving the indication information for the clothing feature adjustment in the virtual character image, if it is determined that the virtual character image is in the locked state, the adjustment of the clothing feature in the virtual character image is prohibited.

According to the solution provided by the embodiment of the present invention, the virtual character image may be locked, that is, when the virtual character image is in an adaptive adjustment state, after receiving the indication information of the clothing adjustment of the virtual character image, the filling algorithm is based on the filling algorithm. Filling the area included in the clothing corresponding to the position information to be adjusted to obtain a generated virtual character image. Upon receiving the indication information for the clothing feature adjustment in the virtual character image, if it is determined that the virtual character image is in the locked state, the adjustment of the clothing feature in the virtual character image is prohibited. It is possible to avoid an erroneous operation that occurs when there is no need to adjust the clothing in the avatar image.

In a third aspect, an embodiment of the present invention provides an image search apparatus, where the apparatus includes:

a receiver, configured to acquire a generated virtual character image;

a processor, configured to determine a color of each pixel of the virtual character image received by the receiver; and obtain, from the acquired color family library, a color family corresponding to a color of each pixel; wherein the color family library For pre-characterizing the corresponding colors of each pixel in a plurality of actual character images, and each class corresponds to one color family, one color family corresponds to one basic color, and one color family includes multiple colors; using each pixel A plurality of colors included in the color family search for an image matching the virtual character image in the target image database.

In a possible design, the receiver is further configured to acquire a plurality of actual character images;

The processor is further configured to obtain the color family library by:

In a possible design, the processor is further configured to separately acquire color blocks describing character features included in each actual character image and color blocks describing the clothing features, including:

In a possible design, the receiver is further configured to:

After the processor initially determines the avatar image based on the clothing feature template and the character feature template, receiving indication information of the clothing adjustment of the avatar image, where the indication information includes location information and direction information to be adjusted;

The processor is further configured to:

In a fourth aspect, the embodiment of the present invention further provides a virtual character image acquiring apparatus, including:

a processor, configured to initially determine a virtual character image based on the clothing feature template and the character feature template;

a receiver, configured to receive, by the user, indication information about a clothing feature adjustment in the virtual character image that is initially determined by the processor, where the indication information includes location information to be adjusted and direction information;

The processor is further configured to perform a filling process on the area included in the clothing corresponding to the position information to be adjusted received by the receiver based on the filling algorithm to obtain the generated virtual character image.

In a possible design, the processor performs a filling process on the area included in the clothing corresponding to the position information to be adjusted based on the filling algorithm to obtain the generated virtual character image, specifically for:

If it is determined that the avatar image is in an adaptive adjustment state, the generated avatar image is obtained by performing a filling process on the region included in the clothing corresponding to the position information to be adjusted based on the filling algorithm.

In a possible design, when the receiver receives the indication information of the clothing feature adjustment in the avatar image, the processor is further configured to determine that the avatar image is in a locked state, Adjustment of the clothing features in the virtual character image is prohibited.

In a fifth aspect, an embodiment of the present invention provides an image search apparatus, including:

An image obtaining unit, configured to acquire the generated virtual character image;

a determining unit, configured to determine a color of each pixel of the virtual character image acquired by the image acquiring unit;

a color obtaining unit, configured to respectively obtain a color family corresponding to a color of each pixel from a color family library, wherein the color family library is obtained by clustering corresponding colors of respective pixels in a plurality of actual character images in advance, and each The class corresponds to a color family, one color family corresponds to one basic color, and one color family includes multiple colors;

And a matching unit configured to search the target image database for an image matching the virtual character image using a plurality of colors included in a color family of each pixel.

In a possible design, the acquiring unit is further configured to acquire a plurality of actual character images;

The device also includes:

a color block obtaining unit, configured to respectively acquire a color block describing a character feature included in each actual character image and a color block describing a clothing feature; the character feature is a physiological feature of the character, and the clothing feature is related to the clothing of the character information;

a color family generating unit, configured to cluster, by using a clustering algorithm, a color block including a character feature included in each actual character image and a color information included in a color block describing the clothing feature to obtain a plurality of classes, and determine each class included The basic color corresponding to several colors;

In a possible design, the color block acquiring unit is specifically configured to:

In a possible design, the device further includes an image generating unit, configured to receive indication information of the clothing adjustment of the virtual character image after the virtual character image is initially determined based on the clothing feature template and the character feature template, The indication information includes location information to be adjusted and direction information;

In a sixth aspect, an embodiment of the present invention provides a virtual person image acquiring device, where the device includes:

a preliminary determining unit, configured to initially determine a virtual character image based on the clothing feature template and the character feature template;

a receiving unit, configured to receive, by the user, indication information about a clothing feature adjustment in the virtual person image determined by the preliminary determining unit, where the indication information includes location information to be adjusted and direction information;

And a generating unit, configured to perform a filling process on the area included in the clothing corresponding to the position information to be adjusted according to the filling algorithm to obtain the generated virtual character image.

In a possible design, the generating unit is specifically configured to:

In a possible design, the generating unit is further configured to: when the receiving unit receives the indication information about the clothing feature adjustment in the virtual character image, if it is determined that the virtual character image is in a locked state, Adjustment of the clothing features in the virtual character image is prohibited.

DRAWINGS

1 is a flowchart of an image search method according to an embodiment of the present invention;

2 is a schematic diagram of a color family library according to an embodiment of the present invention;

3 is a schematic diagram of a method for acquiring a color family library according to an embodiment of the present invention;

4A-4B are schematic diagrams of a human-machine interaction interface for initially determining a virtual character image according to an embodiment of the present invention;

FIG. 5 is a flowchart of a method for acquiring a virtual character image according to an embodiment of the present invention;

FIG. 6 is a schematic diagram of an image search apparatus according to an embodiment of the present invention;

FIG. 7 is a schematic diagram of another image search apparatus according to an embodiment of the present invention;

FIG. 8 is a schematic diagram of a virtual character image acquiring apparatus according to an embodiment of the present invention;

FIG. 9 is a schematic diagram of another virtual character image acquiring apparatus according to an embodiment of the present invention.

detailed description

The present invention will be further described in detail with reference to the accompanying drawings, in which FIG. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

An embodiment of the present invention provides an image search method, a virtual person image acquisition method, and a device, which are used to solve the problem that the clothing template existing in the prior art cannot cover all the cases and the color due to illumination, shadow, visual chromatic aberration, and the like. The problem caused by the deviation of the search results is large. Wherein the method and device are based on the same inventive concept, Since the principles of the method and the device for solving the problem are similar, the implementation of the device and the method can be referred to each other, and the repeated description will not be repeated.

The solution provided by the embodiment of the present invention can be implemented by using one terminal device. The terminal device can be a device such as a computer.

The image search method is provided in the embodiment of the present invention. The image search method is provided in the embodiment of the present invention. The image search method is as shown in FIG. 1 , and the image is searched for, as shown in FIG. 1 , the image of the virtual character is different from the difference between the light, the shadow, the visual color difference and the like. Methods include:

S101. Acquire a generated virtual character image.

Specifically, the generated virtual character image is obtained, and the virtual character image can be generated through the human-computer interaction interface.

S102. Determine a color of each pixel of the generated virtual character image.

S103. Acquire color families corresponding to colors of respective pixels from the color family library.

Wherein, the color family library is obtained by clustering corresponding colors of each pixel in a plurality of actual character images in advance, and each class corresponds to one color family, one color family corresponds to one basic color, and one color family includes more A color, for example, a color family library as shown in FIG.

S104. Search for an image matching the virtual character image in the target image database using a plurality of colors included in a color family of each pixel.

In a possible implementation manner, obtaining the color family library can be implemented as follows, as shown in FIG. 3:

A1, obtain some images of actual characters.

A2, respectively acquiring color blocks describing the character features included in each actual character image and color patches describing the clothing features; the character features are physiological characteristics of the characters, and the clothing features are related information of the clothing on the characters.

When separately obtaining the color block describing the character feature included in each actual character image and the color block describing the clothing feature, the following can be realized:

The background area of each actual character image is separately removed to obtain a mask MASK image including the foreground image of each actual character image.

A3, using a clustering algorithm to cluster the color blocks of the character features included in each actual character image and the color information included in the color block describing the clothing feature to obtain a plurality of classes, and determine the basic colors corresponding to each color included in each class. colour.

Optionally, the color block describing the character feature and the color information included in the color block describing the clothing feature include: red, green, and blue RGB color components or hue, saturation, and lightness components.

Optionally, when the generated virtual character image is obtained, after the initial determination of the virtual character image, the garment of the initially determined virtual character image may be fine-tuned according to the difference between the virtual character image and the actual character's clothing. Implemented as follows:

Receiving, by the clothing feature template and the character feature template, the indication information of the clothing adjustment of the virtual character image, where the indication information includes the position information and the direction information of the clothing adjustment;

Clothing features include: jackets, shirts, pants, shoes, skirts, etc. The color of the garment can vary. Characters include the gender, height, face, facial features, hairstyle, skin color, expression, body shape, and so on.

The padding algorithm can be a flooding fill algorithm, a boundary padding algorithm, and the like. This embodiment of the present invention does not specifically limit this.

In the embodiment of the present invention, the indication information for receiving the clothing adjustment of the virtual character image may be implemented as follows:

Listen to the event that the user mouse drags the costume, and know the position information and direction information that the garment needs to adjust.

The location information that the garment needs to adjust includes the location of the garment and the size of the adjustment. For example, width adjustment, length adjustment, and so on.

Thereby, the area included in the garment to be adjusted is determined according to the position indicated by the mouse, and then the area is processed based on the filling algorithm to obtain the generated virtual character image.

For example, the user initially determines the virtual character image through the human-computer interaction interface and the clothing feature template displayed by the interface and the character feature template. As shown in FIG. 4A and FIG. 4B, the user selects a jacket, a T-shirt, a pants, a shoe, a gender, etc. on the interface, and the pants can be pants or skirts. The user then uses the mouse to drag the garment to be adjusted, such as the left and right spacing of the jacket, the length of the sleeve, and the length of the pants. Therefore, the terminal device monitors the event that the user mouse drags the clothing, obtains the position information and the direction information that the clothing needs to be adjusted, and then fills the area included in the clothing corresponding to the position information to be adjusted according to the flooding filling algorithm to generate the generated result. Virtual character image.

An embodiment of the present invention further provides a method for acquiring a virtual character image. As shown in FIG. 5, the method includes:

S501: After initially determining the virtual person image based on the clothing feature template and the character feature template, receiving, by the user, indication information for adjusting the clothing feature in the virtual character image, where the indication information includes location information to be adjusted and direction information.

S502. Perform a filling process on the area included in the clothing corresponding to the position information to be adjusted according to the filling algorithm to obtain the generated virtual character image.

The padding algorithm can be a flooding fill algorithm, a boundary padding algorithm, and the like. this invention The embodiment does not specifically limit this.

For example, the user initially determines the virtual character image through the human-computer interaction interface and the clothing feature template displayed by the interface and the character feature template. As shown in Figure 2, the user selects a jacket, T-shirt, pants, shoes, gender, etc. on the interface. The user then uses the mouse to drag the garment to be adjusted, such as the left and right spacing of the jacket, the length of the sleeve, and the length of the pants. Therefore, the terminal device monitors the event that the user mouse drags the clothing, obtains the position information and the direction information that the clothing needs to be adjusted, and then fills the area included in the clothing corresponding to the position information to be adjusted according to the flooding filling algorithm to generate the generated result. Virtual character image.

Optionally, the avatar image obtained by performing the filling process on the area included in the clothing corresponding to the position information to be adjusted according to the filling algorithm may be implemented as follows:

Optionally, the method may further include:

Based on the same inventive concept as the method embodiment shown in FIG. 1, an embodiment of the present invention provides an image search apparatus, as shown in FIG. 6, including:

An image obtaining unit 601, configured to acquire the generated virtual character image;

a determining unit 602, configured to determine a color of each pixel of the virtual character image acquired by the image acquiring unit 601;

The color obtaining unit 603 is configured to separately obtain a color family corresponding to the color of each pixel from the color family library, where the color family library is obtained by clustering corresponding colors of each pixel in a plurality of actual character images in advance, and each One class corresponds to one color family, one color family corresponds to one basic color, and one color family includes multiple colors;

The matching unit 604 is configured to search for an image matching the virtual character image in the target image database by using a plurality of colors included in a color family of each pixel.

In a possible design, the image obtaining unit 601 is further configured to acquire a plurality of actual character images;

The device also includes:

a color block obtaining unit 605, configured to respectively acquire a color block describing a character feature included in each actual character image and a color block describing a clothing feature; the character feature is a physiological feature of the character, and the clothing feature is a clothing of the character Related Information;

a color family generating unit 606, configured to cluster, by using a clustering algorithm, a color block including a character feature included in each actual character image and color information included in a color block describing the clothing feature to obtain a plurality of classes, and determine each class to include The basic color corresponding to several colors;

In a possible design, the color block obtaining unit 605 is specifically configured to:

In a possible design, the device further includes an image generating unit 607, configured to receive indication information about the clothing adjustment of the virtual character image after the virtual character image is initially determined based on the clothing feature template and the character feature template. The indication information includes location information to be adjusted and direction information;

The division of the unit in the embodiment of the present invention is schematic, and is only a logical function division. In actual implementation, there may be another division manner. In addition, each functional unit in each embodiment of the present application may be integrated into one processing. In the device, it may be physically present alone, or two or more units may be integrated in one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software function module.

Wherein, when the integrated unit can be implemented in the form of hardware, an image search device as shown in FIG. 7 includes a receiver 701 and a processor 702. The processor 702 can be a central processing unit (English: central processing unit, CPU for short), or a digital processing unit or the like. The image search device further includes a memory 703 for storing a program executed by the processor 702, and a processor 702 for executing a program stored by the memory 703. The memory 703 is also used to store information such as a color family library, a target image database, a clothing feature template, and a character feature template.

The memory 703 may be disposed inside the image search device or may be disposed outside the image search device. The image search device may further include an input/output interface 704 for writing a program and configuration information into the memory 703 through the input/output interface 704 to output the matched image.

The receiver 701, the memory 703, the processor 702, and the input/output interface 704 can be connected through a bus 705. The manner of connection between other components is merely illustrative and not limited. The bus can be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, only one thick line is shown in Figure 7, but it does not mean that there is only one bus or one type of bus.

The memory 703 may be a volatile memory (English: volatile memory), such as a random access memory (English: random-access memory, abbreviation: RAM); the memory 703 may also be a non-volatile memory (English: Non-volatile memory, such as read-only memory (English: read-only memory, abbreviation: ROM), flash memory (English: flash memory), hard disk (English: hard disk drive, abbreviation: HDD) or solid state drive (English) : solid-state drive, abbreviated: SSD), or memory 703 is any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer, but is not limited thereto. The memory 703 may be a combination of the above memories.

a receiver 701, configured to acquire a generated virtual character image;

a processor 702, configured to determine a color of each pixel of the virtual character image received by the receiver 701; and obtain, from the acquired color family library, a color family corresponding to a color of each pixel; wherein the color The family library is obtained by clustering corresponding colors of each pixel in a plurality of actual character images in advance, and each class corresponds to one color family, one color family corresponds to one basic color, and one color family includes multiple colors; The plurality of colors included in the color family of the pixels search for an image matching the virtual character image in the target image database.

In a possible design, the receiver 701 is further configured to acquire a plurality of actual character images;

The processor 702 is further configured to obtain the color family library by:

In a possible design, the processor 702 is further configured to separately acquire, by using the following, a color block describing a character feature included in each actual character image and a color block describing the clothing feature, including:

In a possible design, the receiver 701 is further configured to:

After the processor 702 initially determines the avatar image based on the clothing feature template and the character feature template, receiving the indication information of the clothing adjustment of the avatar image, where the indication information includes location information and direction information to be adjusted;

The processor 702 is further configured to: perform a filling process on the area included in the clothing corresponding to the position information to be adjusted according to the filling algorithm to obtain the generated virtual character image.

Based on the same inventive concept as the embodiment shown in FIG. 5, an embodiment of the present invention provides a virtual person image acquiring device. As shown in FIG. 8, the device includes:

a preliminary determining unit 801, configured to initially determine a virtual character image based on the clothing feature template and the character feature template;

The receiving unit 802 is configured to receive indication information about a clothing feature adjustment in the virtual character image determined by the preliminary determining unit 801, where the indication information includes location information to be adjusted and direction information;

The generating unit 803 is configured to perform a filling process on the area included in the clothing corresponding to the position information to be adjusted according to the filling algorithm to obtain the generated virtual character image.

In a possible design, the generating unit 803 is specifically configured to:

In a possible design, the generating unit 803 is further configured to: when the receiving unit 802 receives the indication information about the clothing feature adjustment in the virtual character image, if the virtual character image is determined to be locked The state prohibits adjustment of the clothing features in the avatar image.

When the integrated unit can be implemented in the form of hardware, a virtual person image acquiring device as shown in FIG. 8 includes a receiver 901 and a processor 902. The processor 902 can be a central processing unit (English: central processing unit, CPU for short), or a digital processing unit or the like. The virtual character image acquiring apparatus further includes a memory 903 for storing a program executed by the processor 902, and the processor 902 is configured to execute a program stored by the memory 903. The memory 903 is also used to store information such as a clothing feature template and a character feature template.

The memory 903 may be disposed inside the avatar image acquisition device or may be disposed outside the avatar image acquisition device. The virtual character image obtaining means may further include an input/output interface 904 for writing a program and configuration information into the memory 903 through the input/output interface 904, and outputting the matched image.

The receiver 901, the memory 903, the processor 902, and the input/output interface 904 can be connected by a bus 905. The manner of connection between other components is merely illustrative and not limited. The bus can be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, only one thick line is shown in Figure 9, but it does not mean that there is only one bus or one type of bus.

The memory 903 can be a volatile memory, such as a RAM; the memory 903 can also be a non-volatile memory, such as a ROM, flash memory, HDD or SSD, or the memory 903 can be used to carry or store an instruction or data structure. The desired program code and any other medium that can be accessed by the computer, but is not limited thereto. The memory 903 may be a combination of the above memories.

The processor 902 is configured to initially determine a virtual character image based on the clothing feature template and the character feature template;

The receiver 901 is configured to receive indication information about a clothing feature adjustment in the virtual character image that is initially determined by the processor 902, where the indication information includes location information to be adjusted and direction information.

The processor 902 is further configured to perform a filling process on the area included in the clothing corresponding to the position information to be adjusted received by the receiver 901 based on the filling algorithm to obtain the generated virtual character image.

In a possible design, the processor 902, when performing the filling process on the area included in the clothing corresponding to the position information to be adjusted based on the filling algorithm to obtain the generated virtual character image, is specifically used to:

In a possible design, when the receiver 901 receives the indication information about the adjustment of the clothing feature in the avatar image, the processor 902 is further configured to determine that the avatar image is in a locked state. When the clothing features in the virtual character image are prohibited from being adjusted.

Those skilled in the art will appreciate that embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.

The present invention has been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (system), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.

The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.

These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

While the preferred embodiment of the invention has been described, it will be understood that Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and the modifications and

It is apparent that those skilled in the art can make various modifications and variations to the invention without departing from the spirit and scope of the invention. Thus, it is intended that the present invention cover the modifications and modifications of the invention

Claims

An image search method, comprising:

Obtain the generated virtual character image;

Determining a color of each pixel of the virtual character image;

Obtaining a color family corresponding to the color of each pixel from the color family library; wherein the color family library is obtained by clustering corresponding colors of each pixel in a plurality of actual character images in advance, and each class corresponds to a color family, One color family corresponds to one basic color, and one color family includes multiple colors;

An image matching the virtual character image is searched in the target image database using a plurality of colors included in the color family of the respective pixels.
The method of claim 1 wherein the obtaining the color family library comprises:

Obtaining images of several actual characters;

Obtaining, respectively, a color block describing a character feature included in each actual character image and a color block describing a clothing feature; the character feature is a physiological feature of the character, and the clothing feature is related information of the clothing on the character;

The clustering algorithm is used to cluster the color blocks including the character features included in each actual character image and the color information included in the color block describing the clothing feature to obtain a plurality of classes, and determine a basic color corresponding to each color included in each class;

Each of these categories includes a number of colors that make up a color family.
The method of claim 2, wherein the color blocks describing the character features and the color information contained in the color patches describing the clothing features comprise: red, green, and blue RGB color components or hue, saturation, and lightness components.
The method according to claim 2 or 3, wherein respectively acquiring the color blocks describing the character features included in each of the actual person images and the color blocks describing the clothing features, comprising:

Removing the background area of each actual character image separately to obtain a mask MASK image including the foreground image of each actual character image;

The color block of the character ornament included in the mask MASK image of the foreground image of the respective actual character image is removed by an edge detection algorithm to obtain a color block describing the character feature and a color block describing the clothing feature.
The method according to any one of claims 1 to 4, wherein the acquiring the generated virtual character image comprises:

Receiving, by the clothing feature template and the character feature template, the indication information of the clothing adjustment of the virtual character image, where the indication information includes position information and direction information to be adjusted;

The generated virtual character image is obtained by performing a filling process on the area included in the clothing corresponding to the position information to be adjusted based on the filling algorithm.
A method for acquiring a virtual character image, comprising:

Receiving, by the user, the indication information of the clothing feature adjustment in the virtual character image after the avatar image and the character feature template are initially determined, the indication information includes position information and direction information to be adjusted;

The generated virtual character image is obtained by performing a filling process on the area included in the clothing corresponding to the position information to be adjusted based on the filling algorithm.
The method according to claim 6, wherein the avatar image is obtained by performing a filling process on the area included in the clothing corresponding to the position information to be adjusted based on the filling algorithm, including:

If it is determined that the avatar image is in an adaptive adjustment state, the generated avatar image is obtained by performing a filling process on the region included in the clothing corresponding to the position information to be adjusted based on the filling algorithm.
The method of claim 7 further comprising:

Upon receiving the indication information for the clothing feature adjustment in the virtual character image, if it is determined that the virtual character image is in the locked state, the adjustment of the clothing feature in the virtual character image is prohibited.
An image search device, comprising:

a receiver, configured to acquire a generated virtual character image;

a processor, configured to determine a color of each pixel of the virtual character image received by the receiver; and obtain, from the acquired color family library, a color family corresponding to a color of each pixel; wherein the color family library For pre-characterizing the corresponding colors of each pixel in a plurality of actual character images, and each class corresponds to one color family, one color family corresponds to one basic color, and one color family includes multiple colors; using each pixel A plurality of colors included in the color family search for an image matching the virtual character image in the target image database.
The device according to claim 9, wherein the receiver is further configured to acquire a plurality of actual person images;

The processor is further configured to obtain the color family library by:

Obtaining, respectively, a color block describing a character feature included in each actual character image and a color block describing a clothing feature; the character feature is a physiological feature of the character, and the clothing feature is related information of the clothing on the character;

The clustering algorithm is used to cluster the color blocks including the character features included in each actual character image and the color information included in the color block describing the clothing feature to obtain a plurality of classes, and determine a basic color corresponding to each color included in each class;

Each of these categories includes a number of colors that make up a color family.
The apparatus of claim 10, wherein the color blocks describing the character features and the color information contained in the color patches describing the clothing features comprise: red, green, and blue RGB color components or hue, saturation, and lightness components.
The device according to claim 10 or 11, wherein the processor is further configured to respectively acquire color blocks describing the character features included in each actual character image and color blocks describing the clothing features, including:

Removing the background area of each actual character image separately to obtain a mask MASK image including the foreground image of each actual character image;

The color block of the character ornament included in the mask MASK image of the foreground image of the respective actual character image is removed by an edge detection algorithm to obtain a color block describing the character feature and a color block describing the clothing feature.
The device according to any one of claims 9 to 12, wherein the receiver is further configured to:

After the processor initially determines the avatar image based on the clothing feature template and the character feature template, receiving indication information of the clothing adjustment of the avatar image, where the indication information includes location information and direction information to be adjusted;

The processor is further configured to:

The generated virtual character image is obtained by performing a filling process on the area included in the clothing corresponding to the position information to be adjusted based on the filling algorithm.
A virtual character image acquiring device, comprising:

a processor, configured to initially determine a virtual character image based on the clothing feature template and the character feature template;

a receiver, configured to receive, by the user, indication information about a clothing feature adjustment in the virtual character image that is initially determined by the processor, where the indication information includes location information to be adjusted and direction information;

The processor is further configured to perform a filling process on the area included in the clothing corresponding to the position information to be adjusted received by the receiver based on the filling algorithm to obtain the generated virtual character image.
The device according to claim 14, wherein the processor performs a filling process on the area included in the clothing corresponding to the position information to be adjusted based on the filling algorithm to obtain the generated virtual character image, specifically for:

If it is determined that the avatar image is in an adaptive adjustment state, the generated avatar image is obtained by performing a filling process on the region included in the clothing corresponding to the position information to be adjusted based on the filling algorithm.
The device of claim 15 further comprising:

When the receiver receives the indication information about the adjustment of the clothing feature in the avatar image, the processor is further configured to: when the avatar image is determined to be in a locked state, prohibiting the image in the avatar The clothing features are adjusted.