WO2016197717A1

WO2016197717A1 - Method and device for inputting information on mobile terminal

Info

Publication number: WO2016197717A1
Application number: PCT/CN2016/080058
Authority: WO
Inventors: 王晋飞
Original assignee: 中兴通讯股份有限公司
Priority date: 2016-01-11
Filing date: 2016-04-22
Publication date: 2016-12-15
Also published as: CN106959811A

Abstract

The present invention relates to mobile terminals. Disclosed are a method and device for inputting information on a mobile terminal, the method comprising: a mobile terminal obtains application information of an application which has been started, and determines whether the application information of the application which has been started is already stored within first rapid input information of the mobile terminal (S101); if the application information is not already stored within the first rapid input information, the mobile terminal uses second rapid input information already stored in the mobile terminal (S102); if the application information is already stored within the first rapid input information, the mobile terminal uses the first rapid input information, and obtains trigger information inputted by a user and preset character set information corresponding to the application information (S103); the mobile terminal inputs the obtained preset character set information into the application which has been started. The present invention takes security into account, directly transfers the preset character set information to a control or app via predetermined trigger means, and implements secure and rapid inputting.

Description

Method and device for inputting information on mobile terminal

Technical field

This document relates to, but is not limited to, the field of terminal technologies, and in particular, to a method and apparatus for inputting information on a mobile terminal.

Background technique

At present, mobile internet has become popular, and to enjoy more service convenience, personal information must be provided to the corresponding service provider. For example, when the user wants to enjoy the convenience of car wash, it is necessary to download a car wash application (app) on the user's mobile terminal, register and fill in the user's personal information item by item, for example, name, mobile phone number, license plate number, bank card number. Etc. If you need to query the vehicle violation information, you may need the engine number. When the user needs a handheld shopping app, you need to fill in the name, mobile number, bank card number, ID number, mailing address or home address. Although a small number of apps provide users with some convenience through mutual authorization, most app service providers still need to repeatedly request the same personal information from users, which has become a major problem for users to use the app.

At present, terminal manufacturers have tried to input a phrase by pop-up, so that the user can press and hold the input box pop-up menu to call and select the preset phrase when inputting information. This method is simplest, but has limited limitations. The application scenario is limited to the common input scenes that support the terminal's own input method. For example, Hammer Technology simplifies the input process of repeated information by long-pressing the action at the focus of the input method, but this method is limited to Non-confidential information that can be saved in plain text, and it is essentially a call of a shortcut phrase, and can only be used in a part of the scene where the input method of the terminal is in an active state, which cannot guarantee security and privacy, and cannot be used for Enter the password into the scene. In addition, the prior art also provides a solution for implementing a shortcut input of a preset character by a simple operation, which draws a point track through the touch screen to correspond to a string of characters, and the correspondence needs to be uploaded to the server, and The server downloads and responds, and the applicable scenario is narrow.

Further, for apps, more and more apps want users to become registered users and stay connected to function properly. Although some apps support the default login after the user name and password are saved, considering the security and privacy requirements, the user still needs to enter the password for each login. The most common is Enter a combination of numbers and letters via a soft keyboard, and a gesture password that simplifies the password entry process to some extent. As the number of apps increases, users forget passwords more frequently, especially for more complex strong passwords, resulting in more complicated reset password operations. Therefore, it has become a trend to simplify the password input process and improve the efficiency of password input. At the same time, when performing payment operations in various types of apps on the mobile terminal, the input payment password has a problem of insufficient security in most scenarios. In view of the importance and privacy of the payment password, the input process is a password keyboard. In the form visible to the eye, there are always loopholes in security. At present, terminal manufacturers have used personal biometric information such as fingerprints instead of payment passwords in cooperation with third-party apps to improve the security and convenience of payment password input, but considering the diversity of third-party payment apps. Each service provider has to jointly develop and open up the underlying associations, and the workload is huge.

Summary of the invention

The following is an overview of the topics detailed in this document. This Summary is not intended to limit the scope of the claims.

The present invention provides a method and apparatus for inputting information on a mobile terminal, which can better solve the problem of inputting information on the mobile terminal safely and quickly.

An embodiment of the present invention provides a method for inputting information on a mobile terminal, including:

The mobile terminal acquires the application information of the activated application, and determines whether the application information of the activated application has been saved in the first shortcut input information of the mobile terminal;

If it is determined that the application information of the activated application is not saved in the first shortcut input information, the second shortcut input information that has been saved in the mobile terminal is used to obtain the preset character group information corresponding to the trigger information input by the user. And inputting the preset character group information to the activated application;

If it is determined that the application information of the activated application is saved in the first shortcut input information, the trigger information input by the user and the preset character group corresponding to the application information are obtained by using the first shortcut input information. Information, and inputting the preset character group information to the activated application.

Optionally, the first shortcut input information is a first relationship mapping table that includes a mapping relationship between the application information, the trigger information, and the preset character group information; the second shortcut input The information is a second relationship mapping table including a mapping relationship between the trigger information and the preset character group information.

Optionally, the step of acquiring the preset character group information corresponding to the trigger information input by the user by using the second shortcut input information that has been saved in the mobile terminal includes:

The mobile terminal monitors trigger information input by the user;

When the trigger information is detected, the preset relationship group information corresponding to the trigger information is searched in the second relationship mapping table.

Optionally, the first relationship mapping table includes a relationship mapping table for regular input and a relationship mapping table for security input, where the trigger information and the user input are obtained by using the first shortcut input information. Before the step of describing the preset character group information corresponding to the application information, the method further includes:

Monitoring the input method keyboard of the mobile terminal;

When it is detected that the local input method keyboard of the mobile terminal is started, determining, by the relationship mapping table for the normal input, acquiring the trigger information input by the user and the preset character group information corresponding to the application information;

When the custom password keyboard of the activated application is started, the trigger information input by the user and the preset character group information corresponding to the application information are obtained by using the relationship mapping table for security input.

Optionally, the step of acquiring the trigger information input by the user and the preset character group information corresponding to the application information by using the first shortcut input information includes:

The mobile terminal monitors trigger information input by the user;

When the trigger information is detected, the trigger information and the preset character group information corresponding to the application information are searched in the relationship mapping table for the normal input or the relationship mapping table for the security input.

Optionally, the step of inputting the preset character group information to the activated application includes:

When the trigger information and the preset character group information corresponding to the application information are found in the relationship mapping table for the normal input, the found preset character group information is directly input to the activated application. Input method focus;

When the trigger information and the preset character group information corresponding to the application information are found in the relationship mapping table for security input, image analysis is performed on the image of the area where the custom password keyboard is located. The screen coordinates of each character in the preset character group information are found, and the virtual touch operation is sequentially performed on the custom password keyboard according to the obtained screen coordinates of each character, thereby implementing the shortcut input. Preset character group information.

Optionally, the trigger information is information input by the user that is received by the mobile terminal when the at least one trigger mode is activated; the triggering manner includes at least one of the following manners: fingerprint recognition, eye pattern or iris recognition, Face recognition, blink recognition, fixed physical buttons, button combinations, gestures, screen touch gestures.

An embodiment of the present invention further provides an apparatus for inputting information on a mobile terminal, including:

The determining module is configured to obtain application information of the activated application of the mobile terminal, and determine whether the application information of the activated application has been saved in the first shortcut input information of the mobile terminal;

The first input module is configured to: when determining that the application information of the activated application is not saved in the first shortcut input information, acquire the trigger information input by the user by using the second shortcut input information that has been saved in the mobile terminal Corresponding preset character group information, and inputting the preset character group information to the activated application;

a second input module, configured to acquire trigger information input by the user and the application information by using the first shortcut input information when determining that the application information of the activated application has been saved in the first shortcut input information Corresponding preset character group information, and inputting the preset character group information to the activated application.

Optionally, the first shortcut input information is a first relationship mapping table that includes a mapping relationship between the application information, the trigger information, and the preset character group information; the second shortcut input information is And a second relationship mapping table including a mapping relationship between the trigger information and the preset character group information.

Optionally, the first relationship mapping table includes a relationship mapping table for regular input and a relationship mapping table for security input, if the determining module determines that the application information of the activated application has been saved in the first In a quick input information, the input of the second input module to the mobile terminal The keyboard is monitored, and when the local input method keyboard of the mobile terminal is started, the trigger information input by the user and the preset character corresponding to the application information are obtained by using the relationship mapping table for regular input. The group information is used to obtain the trigger information input by the user and the preset character group information corresponding to the application information by using the relationship mapping table for the security input when the booting of the custom password is started. .

The embodiment of the invention further provides a computer readable storage medium storing computer executable instructions, which are implemented when executed by a processor.

Compared with the related art, the embodiment of the present invention utilizes various component functions and combinations on the mobile terminal to set preset character group information, such as a login password, by setting a trigger mode on the premise of taking security into consideration. The payment password, basic user information, and the like are directly transmitted to the control or app to receive the input information, so that the mobile terminal can input safely and quickly under various scenarios.

Other aspects will be apparent upon reading and understanding the drawings and detailed description.

BRIEF abstract

1 is a block diagram of a method for inputting information on a mobile terminal according to an embodiment of the present invention;

2 is a block diagram of an apparatus for inputting information on a mobile terminal according to an embodiment of the present invention;

3 is a flowchart of a type of a technical solution for judging a shortcut input monitoring mode according to an embodiment of the present invention;

Figure 4 is a flow chart of the Type A scheme of Figure 3;

Figure 5 is a flow chart of the Type B scheme of Figure 3;

Figure 6 is a flow chart of the Type C scheme of Figure 3;

7 is a flowchart of a Type A fingerprinting scheme provided by an embodiment of the present invention;

FIG. 8 is a flowchart of a Type B fingerprint solution according to an embodiment of the present invention;

FIG. 9 is a flowchart of a Type C fingerprinting scheme provided by an embodiment of the present invention.

Embodiments of the invention

Embodiments of the present invention will be described in detail below with reference to the accompanying drawings. It should be noted that, in the case of no conflict, the features in the embodiments and the embodiments in the present application may be arbitrarily combined with each other.

1 is a block diagram of a method for inputting information on a mobile terminal according to an embodiment of the present invention. As shown in FIG. 1, the steps include:

Step S101: The mobile terminal acquires the application information of the activated application, and determines whether the application information of the activated application has been saved in the first shortcut input information of the mobile terminal.

The first shortcut input information is a first relationship mapping table that includes a mapping relationship between the application information, the trigger information, and the preset character group information.

The preset character group information includes, but is not limited to, a user-defined phrase, a user's personal information, a login name of each application (app), a login password, a payment (transaction) password, etc., and the preset character group information is strong. The encryption mode is stored in the local secure storage area of the mobile terminal.

Step S102: If it is determined that the application information of the activated application is not saved in the first shortcut input information, the second shortcut input information that has been saved in the mobile terminal is used to obtain a preset corresponding to the trigger information input by the user. Character group information, and inputting the preset character group information to the activated application.

The second shortcut input information is a second relationship mapping table that includes a mapping relationship between the trigger information and the preset character group information.

If the application information of the activated application is not saved in the first shortcut input information, the second shortcut input information is used, that is, the second relationship mapping table is used for shortcut input. Specifically, the mobile terminal monitors the trigger information input by the user, and when the trigger information is detected, searches the second relationship mapping table for the preset character group information corresponding to the trigger information, and sets the preset character group. Information is entered at the input controls.

Step S103: If it is determined that the application information of the activated application has been saved in the first shortcut In the information, the first shortcut input information is used to obtain the trigger information input by the user and the preset character group information corresponding to the application information, and input the preset character group information to the activated application. .

Since the app uses the local input method keyboard of the mobile terminal, the preset character group can be directly transmitted, and when the app uses its own custom password keyboard, the preset character group cannot be directly input, so the present invention needs to The input method keyboard of the mobile terminal performs monitoring, and classifies the first relationship mapping table into a relationship mapping table for regular input and a relationship mapping table for security input, so that local input of the mobile terminal is monitored After the keyboard is started, if the trigger information input by the user is detected, the relationship mapping table for the normal input may be used to obtain the trigger information input by the user and the preset character group information corresponding to the application information, and The found preset character group information is directly input to the input method focus of the activated application; after the startup of the custom password keyboard of the activated application is detected, if the trigger information input by the user is monitored, the use may be utilized. Obtaining the trigger information input by the user and the preset character group information corresponding to the application information in the relationship mapping table of the security input, When inputting, by performing image analysis on the image of the area where the custom password keyboard is located, the screen coordinates of each character in the found preset character group information are obtained, and according to the obtained screen coordinates of each character, The virtual touch operation is sequentially performed on the custom password keyboard, so that the preset character group information is quickly input.

The trigger information is information input by the user that is received by the mobile terminal when the at least one trigger mode is activated, and the triggering manner includes fingerprint recognition, eye pattern or iris recognition, face recognition, blink recognition, fixed physical buttons, and buttons. Trigger methods such as combination, gesture action, and screen touch gesture.

For example, the mobile terminal newly downloads to the local app1, and the user is not registered. After the app1 is started, the corresponding preset character group information, such as the name, the mobile phone number, the ID card number, and the home address, may be found in the second mapping table according to the trigger information. , mail address, etc., and passed to the input control of app1, to achieve quick input of personal information.

For example, the mobile terminal local app2, the user has registered, its application information and corresponding trigger information and preset character group information (such as payment password, login password, etc.) are saved in the first mapping table, and after the app2 is started, the trigger may be triggered according to The information finds the preset character group information of the app2, and passes it to the input control of the app2, which simplifies the password input process, improves the password input efficiency, ensures the security of the password input, and avoids the password reset caused by the user forgetting the password. Trivial operation.

For example, the mobile terminal local app3, the user has registered, but the application information is not saved in the first mapping table. After the app3 is started, the corresponding preset character group information may be found in the second mapping table according to the trigger information, and transmitted. Give the input controls to app3.

FIG. 2 is a block diagram of a device for quickly inputting preset character group information on a mobile terminal according to an embodiment of the present invention. As shown in FIG. 2, the method includes a judging module 10, a first input module 20, and a second input module 30.

The determining module 10 is configured to obtain application information of the activated application of the mobile terminal, and determine whether the application information of the activated application has been saved in the first shortcut input information of the mobile terminal. The first shortcut input information is a first relationship mapping table including a mapping relationship between the application information, trigger information, and preset character group information, and includes a relationship mapping table for regular input and is used for security. Enter the relationship mapping table. The application information in the first relationship mapping table may be app attribute information, such as an app package name. The preset character group information in the first relationship mapping table may be information such as a login password, a payment password, a query password, and the like.

The first input module 20 is configured to: when determining that the application information of the activated application is not saved in the first shortcut input information, acquire the trigger of the user shortcut input by using the second shortcut input information that has been saved in the mobile terminal The preset character group information corresponding to the information, and inputting the preset character group information to the activated application. The second shortcut input information is a second relationship mapping table that includes a mapping relationship between the trigger information and the preset character group information. The preset character group information in the second relationship mapping table may be personal common information such as a name, a mobile phone number, an ID card number, a home address, and an email address. If the determining module 10 determines that the application information of the activated application is not saved in the first relationship mapping table, the first input module 20 monitors trigger information input by the user, and when the trigger information is detected, The preset relationship group information corresponding to the trigger information is searched in the second relationship mapping table, and the found preset character group information is directly input to the input method focus of the activated application.

The second input module 30 is configured to: when determining that the application information of the activated application has been saved in the first shortcut input information, use the first shortcut input information to acquire trigger information input by the user and the application The preset character group information corresponding to the information, and inputting the preset character group information to the activated application. After the second input module 30 detects that the local input method keyboard of the mobile terminal is started, if the trigger information input by the user is monitored, the second input module 30 can be used for regular input. a relationship mapping table, the trigger information input by the user and the preset character group information corresponding to the application information are obtained, and the found preset character group information is directly input to the input method focus of the activated application; After the startup password of the activated application is started, if the trigger information input by the user is detected, the relationship mapping table for the security input may be used to obtain the trigger information input by the user and the preset character corresponding to the application information. Group information, during image input, by performing image analysis on the image of the area where the custom password keyboard is located, obtaining screen coordinates of each character in the found preset character group information, and according to each character obtained The screen coordinates are sequentially performed on the custom password keyboard, so that the preset character group information is quickly input.

FIG. 3 is a flowchart of a technical solution for determining a shortcut input monitoring mode according to an embodiment of the present invention. As shown in FIG. 3, the steps include:

Step S301: The mobile terminal is in a standby state.

Step S302: The mobile terminal enters the shortcut input monitoring mode.

The shortcut input monitoring mode described in this embodiment enters the monitoring state after the mobile terminal is powered on, and is responsible for determining which shortcut input technical solution the mobile terminal should perform, and when and how to initiate the shortcut input.

Step S303: A certain app on the mobile terminal is started.

Step S304: Detecting the mapping table to which the currently started app belongs, determining whether the currently launched app is in the mapping table, if yes in the mapping table, executing step S306, otherwise performing step S305.

Step S305: The mobile terminal determines, in the shortcut input monitoring mode, that the implementation scheme of the current shortcut input adopts Type A.

Step S306: Monitor the input method keyboard. If the custom password keyboard is started, step S308 is performed. If the local input method keyboard is started, step S307 is performed.

Step S307: The mobile terminal determines, in the shortcut input monitoring mode, that the implementation scheme of the current shortcut input adopts the Type B scheme.

Step S308: The mobile terminal determines, in the shortcut input monitoring mode, that the implementation scheme of the current shortcut input adopts the Type C scheme.

It can be seen that the present invention defines three basic shortcut input schemes according to the application (app) in which the mobile terminal is currently in an active state and the input keyboard type that is invoked. The differences between the three schemes are:

1.Type A: The current app has no mapping information in the mapping table;

2.Type B: The current app has mapping information in the mapping table, and the current input method keyboard is a local input method keyboard, that is, the system default keyboard and the keyboard whose output key value is under the control of the system authority;

3.Type C: The current app has mapping information in the mapping table, and the current input method keyboard is an app custom password keyboard, that is, a security keyboard.

The relationship mapping table between the triggering mode and the preset character group information defined in the present invention is stored in the local secure storage area of the mobile terminal, and corresponds to the three schemes. The basic structure of the relationship mapping table is shown in Table 1.

Table 1. Relationship mapping between trigger information and preset character group information

The triggering modes listed in the present invention are applicable to different shortcut input schemes according to their basic principles and characteristics.

Table 2. Degree of support for different triggering methods by the three technical solutions

If a trigger mode has only one type of trigger information, for example, the face recognition trigger mode can only have one type of facial feature information, then only one set of character sets can be corresponding to a type of mapping table, and this case is defined as “one-to-one”; If a certain triggering method can have multiple triggering information, for example, the fingerprint identification method may have multiple sets of fingerprint information, then one type of mapping table may respectively correspond to multiple sets of character groups, and this situation is defined as “many-to-many”; Considering the use of different applications, adding a dimension will also result in a "one-to-many" situation in Type B and Type C. The triggering methods for various preset information input include fingerprint, eye pattern, face recognition, blink recognition, fixed physical button or button combination, gesture action, screen gesture, etc., and the possible support conditions are shown in Table 2.

4 is a flow chart of the Type A scheme of FIG. 3, and if the shortcut input monitoring mode is determined to be Type A The scheme starts the trigger monitoring mechanism. When the triggered trigger information is successfully detected, the mapping table A is queried, and the corresponding character group information is obtained according to the trigger information, and is transmitted to the current input method focus to complete a shortcut input action. As shown in Figure 4, the steps include:

Step S401: The mobile terminal is in a standby state.

Step S402: The mobile terminal enters the shortcut input monitoring mode.

Step S403: A certain app on the mobile terminal is started.

Step S404: Monitor the mapping table to which the currently started app belongs, and determine whether the currently launched app is in the mapping table. If the mapping table is in the mapping table, execute step S405; otherwise, execute step S406.

Step S405: The mobile terminal determines, in the shortcut input monitoring mode, that the implementation scheme of the current shortcut input adopts a Type B scheme or a Type C scheme.

Step S406: The mobile terminal determines that the implementation scheme of the current shortcut input adopts the Type A scheme in the shortcut input monitoring mode, and monitors the input method keyboard, thereby starting the trigger monitoring mechanism.

Step S407: When the local input method keyboard is started, the loop trigger information is cyclically monitored.

Step S408: When the triggered trigger information is successfully detected, the mapping table A (ie, the second relationship mapping table) is queried to obtain the character group information corresponding to the trigger information.

Step S409: The obtained character group information is delivered to the current input method focus.

Step S410: A shortcut input action is completed, and step S402 is performed.

The Type A scheme of the present invention can replace the preset character group information by using the common input method to preset the shortcut phrase, but the convenience is slightly worse than the embodiment.

FIG. 5 is a flowchart of the Type B scheme in FIG. 3, if the shortcut input monitoring mode is determined to be a Type B scheme, a trigger monitoring mechanism is started; when the triggered trigger information is monitored, the mapping table B is queried according to the current application attribute and Trigger information to obtain the corresponding character group information, and pass it to the current input method focus to complete a shortcut input action. As shown in Figure 5, the steps include:

Step S501: The mobile terminal is in a standby state.

Step S502: The mobile terminal enters the shortcut input monitoring mode.

Step S503: an app on the mobile terminal is started.

Step S504: Detecting the mapping table to which the currently started app belongs, and determining whether the currently launched app is in the mapping table. If not in the mapping table, step S505 is performed; otherwise, step S506 is performed.

Step S505: The mobile terminal determines, in the shortcut input monitoring mode, that the implementation scheme of the current shortcut input adopts the Type A scheme.

Step S506: The input method keyboard is monitored. When the custom password keyboard is detected to start, step S507 is performed, and when the local input method keyboard is detected to be started, step S508 is performed.

Step S507: The mobile terminal determines, in the shortcut input monitoring mode, that the implementation scheme of the current shortcut input adopts the Type C scheme.

Step S508: When the local input method keyboard is started, the loop trigger information is cyclically monitored.

Step S509: When the trigger information for triggering success is monitored, the mapping table B (ie, the relationship mapping table for regular input in the first relationship mapping table) is queried to obtain the character group information corresponding to the trigger information.

Step S510: Pass the obtained character group information to the current input method focus.

Step S511: A shortcut input action is completed, and step S502 is performed.

The Type B solution of this embodiment can be replaced by a combination of custom development and deep customization with multiple or all third party apps, but the implementation cost of the embodiment is the lowest, no need for customized development, and convenient and flexible.

6 is a flow chart of the Type C scheme of FIG. 3. If the shortcut input monitoring mode is determined to be a Type C scheme, a trigger monitoring mechanism is activated; when the triggered trigger information is monitored, the area of the password keyboard on the current screen is first obtained. Information, take a screenshot and perform image analysis to obtain the screen coordinate information corresponding to all the characters on the keyboard, then query the mapping table C, obtain the corresponding character group information according to the current application attribute and the trigger information, and then compare and judge the characters obtained from the image analysis. Whether the character information in all the preset character group information is already included. If it is not complete, the virtual click key switch keyboard button is used to obtain the image analysis and comparison of the next layer keyboard, and then the preset character group information is converted into the The screen coordinate information on the password keyboard, and convert the coordinate information into a virtual touch operation to complete a quick input action. As shown in Figure 6, the steps include:

Step S601: The mobile terminal is in a standby state.

Step S602: The mobile terminal enters the shortcut input monitoring mode.

Step S603: A certain app on the mobile terminal is started.

Step S604: Detecting the mapping table to which the currently launched app belongs, and determining whether the currently launched app is in the mapping table. If not in the mapping table, step S605 is performed; otherwise, step S606 is performed.

Step S605: The mobile terminal determines, in the shortcut input monitoring mode, that the implementation scheme of the current shortcut input adopts the Type A scheme.

Step S606: The input method keyboard is monitored. When the local input method keyboard is detected to start, step S607 is performed, and when the custom password keyboard is detected to be started, step S608 is performed.

Step S607: The mobile terminal determines, in the shortcut input monitoring mode, that the implementation scheme of the current shortcut input adopts the Type B scheme.

Step S608: When the custom password keyboard is started, the loop trigger information is cyclically monitored.

Step S609: Acquire area range information of the custom password keyboard on the current screen.

Step S610: Perform a screenshot on the custom password keyboard according to the acquired area range information.

Step S611: Perform image analysis on the obtained screenshot to obtain screen coordinate information corresponding to all characters (including numbers, letters, etc.) on the keyboard.

Step S612: Query the mapping table C (ie, the relationship mapping table for security input in the first relationship mapping table), and obtain corresponding character group information according to the current application attribute and the trigger information.

Step S613: It is determined whether all the characters obtained in step S611 already contain the character information in all the preset character group information. If yes, step S615 is performed, otherwise step S614 is performed.

Step S614: Virtually clicking the switch button of the custom password keyboard to obtain the area range information of the next layer of the keyboard, and executing step S610.

Step S615: sequentially obtain screen coordinate information of the corresponding character according to the order of the characters in the preset character group information.

Step S616: Perform a virtual touch operation according to the screen coordinate information obtained in step S615.

Step S617: A shortcut input action is completed, and step S602 is performed.

That is to say, for Type C, it is necessary to perform image recognition processing on a third-party soft keyboard (password keyboard or security keyboard), and adopt a virtual touch input mechanism.

The Type C solution of this embodiment can be replaced by a combination of custom development and deep customization with multiple or all third party apps, but the implementation cost of the embodiment is the lowest, no need for customized development, convenient and flexible.

In the embodiment of the present invention, by setting a specific trigger information, a corresponding relationship between each application (app) and a preset character group on the mobile terminal, when the trigger condition is met, the preset character group is directly transmitted to the current input control manner. Solve the problem of character group shortcut input. For the third-party application, a custom password keyboard is used, and characters cannot be directly transmitted. The character input problem can be solved by image recognition and virtual touch; the definition of the preset character group information and the image recognition technology are involved. Application, definition of multiple trigger mechanisms, definition of fast input monitoring mode, definition of three basic technology implementation schemes, etc.

The image recognition technology used in the embodiment of the present invention is an existing and mature technical solution. The present invention does not repeat the above, that is, the existing image recognition technology can be used to perform the security keyboard area in the current display screen of the mobile terminal. Image recognition processing, obtaining key coordinates of numbers, letters, case switching, etc. on the keyboard.

The mechanism for triggering the automatic input action of the preset character group information according to the embodiment of the present invention includes, but is not limited to, fingerprint recognition, eye pattern (or iris) recognition, face recognition, blink recognition, fixed physical button or button combination, Trigger actions such as gestures and screen touch gestures.

Typically, fingerprint identification is taken as an example, and the above three schemes are explained in conjunction with FIG. 7 to FIG. The implementation scenarios of other trigger modes are similar to the fingerprint touch mode. The methods of sensor monitoring, triggering, security, and fault tolerance are different.

FIG. 7 is a flowchart of a Type A fingerprinting scheme provided by an embodiment of the present invention. As shown in FIG. 7, the steps include:

Step S701: The mobile terminal is in a standby state.

Step S702: The mobile terminal enters the shortcut input monitoring mode.

Step S703: A certain app on the mobile terminal is started.

Step S704: Monitor the mapping table to which the currently started app belongs, and determine whether the currently launched app is in the mapping table. If the mapping table is in the mapping table, execute step S705; otherwise, perform step S706.

Step S705: The mobile terminal determines, in the shortcut input monitoring mode, that the implementation scheme of the current shortcut input adopts a Type B scheme or a Type C scheme.

Step S706: The mobile terminal determines, in the shortcut input monitoring mode, that the implementation scheme of the current shortcut input adopts the Type A scheme, and monitors the input method keyboard, thereby starting the trigger monitoring mechanism.

Step S707: When the local input method keyboard is started, the fingerprint information input state is cyclically monitored.

Step S708: When the fingerprint information is monitored, if the first input is performed, the fingerprint verification counter n=0 is initialized, and the fault tolerance check is performed. If the information is repeated, step S709 is performed; otherwise, step S710 is performed.

Step S709: When the current fingerprint information is the same as the last fingerprint information, an error prompt is activated and step S707 is re-executed.

Step S710: When the current fingerprint information is different from the previous fingerprint information, it is determined whether the count value n of the fingerprint check counter is less than the threshold value, if yes, step S712 is performed, otherwise step S711 is performed;

The threshold is set to a threshold number of input errors, such as set to 3

Step S711: The shortcut input mode is frozen, and after the preset protection time M, step S702 is re-executed.

Step S712: performing fingerprint verification, that is, matching the fingerprint information with the fingerprint information in the mapping table A. If there is matching fingerprint information in the mapping table A, the verification passes, and step S713 is performed; otherwise, the fingerprint verification counter is executed. The count value n is incremented by 1, and step S707 is executed to return the fingerprint monitoring state and give a prompt.

Step S713: Obtain the character group information corresponding to the fingerprint information from the mapping table A.

Step S714: The obtained character group information is delivered to the current input method focus.

Step S715: Determine the state of the local input method. If the input method keyboard is closed or hidden by the user, the input state ends, and step S702 is performed. Otherwise, the input state is still continued, and step S707 is performed.

It is assumed that the user pre-stores three sets of fingerprint information in the mobile terminal, wherein the fingerprint 1 corresponds to the mapping The character group A1 (for example, a name) in the table A, the fingerprint 2 corresponds to the character group A2 (for example, a mobile phone number) in the mapping table A, and the fingerprint 3 corresponds to the character group A3 (for example, a mailing address) in the mapping table A. After the user starts an app (which can be a local application) on the mobile terminal, clicks on a certain control to start the input action. At this time, the shortcut input monitoring mode running in the background first detects the mapping table of the current app, if there is a mapping table in the mapping table. The app package name adopts the Type B and Type C schemes; this embodiment assumes that the app is not in the mapping table, and the default is the Type A scheme.

When the user clicks on the control and starts inputting the action, the local input method keyboard is activated, and the quick input monitoring mode monitors the action, and the background sends a fingerprint input instruction to the fingerprint sensor, and starts the cyclic monitoring of the fingerprint information. When the fingerprint information is detected, the fault-tolerant test is first performed to determine whether the fingerprint information is the same as the previous one. If the same, it belongs to the repeated input (may be user misoperation), start the error prompt and re-enter the fingerprint monitoring. Status; if it is different from last time, it is judged whether the fingerprint verification counter n is smaller than the threshold value, then the fingerprint information is compared with the fingerprint information in the mapping table A, and if there is matching fingerprint data, the verification is passed; otherwise, n is incremented 1. Return the fingerprint monitoring status and give a prompt.

Assuming that the fingerprint information is fingerprint 1, the next step is to perform the action of querying the mapping table A, and then find the corresponding character group A1 (name); then pass the character group A1 to the focus of the current input method, that is, input the name to Enter the control; check the status of the input method. If the input method keyboard is closed or hidden, the input is considered to be finished, and the shortcut input monitoring mode is returned. If the input method keyboard is not closed or hidden by the user, the fingerprint input information is continuously monitored. For example, if the user chooses to continue inputting at this time, and clicks another control again to activate the input method focus, the input method is still activated. When the user inputs the fingerprint 2, the character group A2 (mobile phone number) is transmitted in the control, and so on. .

Considering the security factor, if the fingerprint counter n=3, that is, three consecutive invalid or incorrect fingerprints that are not in the mapping table are input, the shortcut input mode is frozen and thawed after the preset protection time M.

FIG. 8 is a flowchart of a Type B fingerprinting scheme provided by an embodiment of the present invention. As shown in FIG. 8, the steps include:

Step S801: The mobile terminal is in a standby state.

Step S802: The mobile terminal enters the shortcut input monitoring mode.

Step S803: an app on the mobile terminal is started.

Step S804: Detecting the mapping table to which the currently started app belongs, and determining whether the currently launched app is in the mapping table. If not in the mapping table, step S805 is performed; otherwise, step S806 is performed.

Step S805: The mobile terminal determines, in the shortcut input monitoring mode, that the implementation scheme of the current shortcut input adopts the Type A scheme.

Step S806: The input method keyboard is monitored. When the custom password keyboard is detected to start, step S807 is performed, and when the local input method keyboard is detected to be started, step S808 is performed.

Step S807: The mobile terminal determines that the implementation scheme of the current shortcut input adopts the Type C scheme in the shortcut input monitoring mode.

Step S808: When the local input method keyboard is started, the fingerprint information input state is cyclically monitored.

Step S809: When the fingerprint information is monitored, if the first input is performed, the fingerprint verification counter n=0 is initialized, and the fault tolerance check is performed. If the information is repeated, step S810 is performed; otherwise, step S811 is performed.

Step S810: When the current fingerprint information is the same as the last fingerprint information, an error prompt is activated and step S808 is re-executed.

Step S811: When the current fingerprint information is different from the previous fingerprint information, it is determined whether the count value n of the fingerprint verification counter is less than the threshold value, if yes, step S813 is performed, otherwise step S812 is performed;

The threshold is set to a threshold number of times the error is input, for example, set to 3.

Step S812: The shortcut input mode is frozen, and after the preset protection time M, step S802 is re-executed.

Step S813: performing fingerprint verification, that is, matching the fingerprint information with the fingerprint information in the mapping table B. If there is matching fingerprint information in the mapping table B, the verification passes, and step S814 is performed; otherwise, the fingerprint verification counter is executed. The count value n is incremented by 1, and step S808 is executed to return the fingerprint monitoring state and give a prompt.

Step S814: Obtain the character group information corresponding to the fingerprint information from the mapping table B.

Step S815: Pass the obtained character group information to the current input method focus.

Step S816: Determine the state of the local input method. If the input method keyboard is closed or hidden by the user, the input state ends, and step S802 is performed. Otherwise, the input state is still continued, and step S808 is performed.

The user stores the fingerprint 1 in advance, and specifies that the corresponding character group of the fingerprint 1 in the app1 (for example, 12306) is the character group B1 (12306 login password), and the corresponding character group in the app2 (for example, China Merchants Bank) is the character group B2 (China Merchants Bank) Login password), the user stores this mapping relationship in mapping table B.

Assume that on the user's mobile terminal, the shortcut input monitoring mode is in the background resident state. When the app1 is started (for example, 12306), the app requests to input the login password, the user clicks the password input control, and the shortcut input monitoring mode first detects the mapping table of the current app. If the current app (12306) package name has information in the mapping table B, it is determined that the Type B scheme is adopted.

When the local input method keyboard is activated, when the quick input monitoring mode detects that the input method keyboard is started, the fingerprint command is sent to the fingerprint sensor at the same time, and the fingerprint monitoring is started; when the fingerprint information is detected, the fault tolerance test is first performed. It is used to judge whether the fingerprint information is the same as the last time. If it is the same, it belongs to repeated input (may be user misoperation), activates the error prompt and re-enters the fingerprint monitoring state; if it is different from the last time, determines whether the fingerprint verification counter n is If the value is less than the threshold, the fingerprint information is compared with the fingerprint information in the mapping table B. If there is matching fingerprint data, the verification is passed. Otherwise, n is incremented by 1, and the fingerprint monitoring state is returned and a prompt is given.

Assuming that the fingerprint information is fingerprint 1, the next step is to perform the operation of querying the mapping table B, and then find the corresponding character group B1 (ie, 12306 login password); then pass the character group B1 to the current input method focus, that is, the password Input to the input control; check the status of the input method, if the input method keyboard is closed or hidden, the input is considered to be finished, that is, the user thinks that the password shortcut input action has been completed, and the next operation is selected, then the shortcut input monitoring mode is returned. If the input method keyboard is not closed or hidden by the user, continue to monitor the fingerprint input information.

FIG. 9 is a flowchart of a Type C fingerprinting solution according to an embodiment of the present invention. As shown in FIG. 9, the steps include:

Step S901: The mobile terminal is in a standby state.

Step S902: The mobile terminal enters the shortcut input monitoring mode.

Step S903: an app on the mobile terminal is started.

Step S904: Detecting the mapping table to which the currently started app belongs, and determining whether the currently started app is in the mapping table. If not in the mapping table, step S905 is performed; otherwise, step S906 is performed.

Step S905: The mobile terminal determines, in the shortcut input monitoring mode, that the implementation scheme of the current shortcut input adopts the Type A scheme.

Step S906: The input method keyboard is monitored. When the local input method keyboard is detected to start, step S907 is performed, and when the custom password keyboard is detected to be started, step S908 is performed.

Step S907: The mobile terminal determines, in the shortcut input monitoring mode, that the implementation scheme of the current shortcut input adopts the Type B scheme.

Step S908: When the custom password keyboard is started, the fingerprint information input state is cyclically monitored.

Step S909: When the fingerprint information is monitored, if the first input is performed, the fingerprint verification counter n=0 is initialized, and the fault tolerance check is performed. If the information is repeated, step S910 is performed, otherwise step S911 is performed.

Step S910: When the current fingerprint information is the same as the last fingerprint information, an error prompt is activated and step S908 is re-executed.

Step S911: When the current fingerprint information is different from the previous fingerprint information, it is determined whether the count value n of the fingerprint verification counter is less than the threshold value, if yes, step S913 is performed, otherwise step S912 is performed;

Step S912: The shortcut input mode is frozen, and after the preset protection time M, step S902 is re-executed.

Step S913: performing fingerprint verification, that is, matching the fingerprint information with the fingerprint information in the mapping table B. If there is matching fingerprint information in the mapping table B, the verification passes, and step S914 is performed; otherwise, the fingerprint verification counter is executed. The count value n is incremented by 1, and step S908 is performed to return the fingerprint monitoring. Status and give a hint.

Step S914: Acquire area range information of the custom password keyboard on the current screen.

Step S915: Perform a screenshot on the custom password keyboard according to the obtained area range information.

Step S916: Perform image analysis on the obtained screenshot to obtain screen coordinate information corresponding to all characters (including numbers, letters, etc.) on the keyboard.

Step S917: Query the mapping table C, and obtain corresponding character group information according to the current application attribute and the trigger information.

Step S918: It is determined whether all the characters obtained in step S916 already contain the character information in all the preset character group information. If yes, step S920 is performed, otherwise step S919 is performed.

Step S919: Virtually click the switch button of the custom password keyboard to obtain the area range information of the next layer of the keyboard, and step S915 is performed.

Step S920: sequentially obtain screen coordinate information of the corresponding character according to the order of the characters in the preset character group information.

Step S921: Perform a virtual touch operation according to the screen coordinate information obtained in step S920.

Step S922: Determine the state of the local input method. If the input method keyboard is closed or hidden by the user, the input state ends, and step S902 is performed. Otherwise, the input state is still continued, and step S908 is performed.

It is assumed that the user pre-stores the fingerprint 1 and specifies that the corresponding character group of the fingerprint 1 in the app1 (for example, Alipay) is the character group C1 (the payment password of Alipay), and the corresponding character group in the app2 (for example, China Merchants Bank) is the character group C2 (investment) The transaction password of the bank), the user stores this mapping relationship in the mapping table C. At the same time, the user specifies that the fingerprint 1 corresponds to the character group B1 (such as the payment package login password) in app1 (ie, Alipay), and stores it in the mapping table B.

On the user mobile terminal, the shortcut input monitoring mode is in the background resident state. When the app1 (Alipay) is started, the shortcut input monitoring mode first detects the mapping table of the current app, and queries the current app (Alipay) package name in the mapping table B, There is information in C, this fashion can not judge which plan to adopt.

If in the app1, the user clicks on a certain control to call the local input method, it is determined to be the Type B scheme; if the user enters the last step of the payment process, that is, the app asks to input the payment password, When the smart input mode detects that the custom password keyboard of app1 is popped up, it is determined to be the Type C scheme.

The quick input monitoring mode sends a fingerprint receiving command to the fingerprint sensor, and starts fingerprint monitoring. When detecting the receipt of fingerprint information, the fault tolerance test is first performed to determine whether the fingerprint information is the same as the last time, and if it is the same, it is a duplicate. Input (may be user misoperation), start error prompt and re-enter fingerprint monitoring status; if it is different from last time, judge whether fingerprint verification counter n is less than the threshold, then compare fingerprint information with fingerprint information in mapping table C If there is matching fingerprint data, the verification is passed, otherwise the fingerprint monitoring status is returned and a prompt is given.

Assuming that the fingerprint information is fingerprint 1, after the fingerprint verification is passed, the shortcut input monitoring mode requests the mobile terminal to obtain the password keyboard drawing area range information, and passes it to the cryptographic keyboard image processing unit, and the unit performs an image on the screen capture information. Analyze to get the screen coordinate information corresponding to all the numbers or letters on the current keyboard.

Then, the action of querying the mapping table C is performed, and the fingerprint information and the app information are correspondingly matched to the character group C1 (ie, the Alipay payment password); then all the characters of C1 are compared with the character extraction result of the password keyboard image processing unit, if the current keyboard If all the character information of C1 is already included, the C1 character is sequentially converted into screen coordinate information, and is transmitted to the virtual touch unit to perform a virtual click operation; if the character of C1 is not on the current keyboard, the password keyboard switch is performed by the virtual touch unit. Operation (for example, switching from the numeric keypad to the alphanumeric keyboard), and recording the switching operation as a click operation; then the second screen capture analysis by the cryptographic keyboard image processing unit and giving the coordinates of the missing characters; after the comparison analysis, the C1 conversion is performed. The final virtual click input operation is performed by the virtual touch unit for a series of screen coordinate parameters in which the numeric keypad coordinates, the toggle button coordinates, and the alphanumeric keyboard coordinates are combined with each other.

After the virtual input is completed, check the status of the input method. If the input method keyboard is closed or hidden, the input is considered to be ended, that is, the user or the app thinks that the password shortcut input action has been completed, and the next operation is selected, and then the shortcut input monitoring mode is returned. If the input method keyboard is not closed or hidden by the user, continue to monitor the fingerprint input information.

The embodiment of the invention can achieve a good balance between security, practicability and convenience. After the user has three modes of flexibility, the user can input the common information more conveniently, and enjoy the safe and comfortable payment by the mobile payment. The sense of excitement, eliminating the inconvenience of forgetting the password, the user's repetitive character input experience will be fundamentally improved.

One of ordinary skill in the art will appreciate that all or a portion of the above steps may be performed by a program to instruct related hardware, such as a processor, which may be stored in a computer readable storage medium, such as a read only memory, disk or optical disk. Wait. Alternatively, all or part of the steps of the above embodiments may also be implemented using one or more integrated circuits. Correspondingly, each module/unit in the above embodiment may be implemented in the form of hardware, for example, by implementing an integrated circuit to implement its corresponding function, or may be implemented in the form of a software function module, for example, executing a program stored in the memory by a processor. Instructions to achieve their corresponding functions. This application is not limited to any specific combination of hardware and software.

It should be noted that various other embodiments and modifications may be made by those skilled in the art without departing from the spirit and scope of the application, Corresponding changes and modifications are intended to fall within the scope of the appended claims.

Industrial applicability

The technical solution provided by the embodiment of the invention can achieve a good balance between security, practicability and convenience. After the user has three modes of flexibility, the user can input personal information more conveniently, and enjoy the movement more safely and comfortably. The quick feeling of quick payment and the inconvenience caused by forgetting the password will greatly improve the user's repetitive character input experience.

Claims

A method of inputting information on a mobile terminal, comprising:

The mobile terminal acquires the application information of the activated application, and determines whether the application information of the activated application has been saved in the first shortcut input information of the mobile terminal;

If it is determined that the application information of the activated application is not saved in the first shortcut input information, the second shortcut input information that has been saved in the mobile terminal is used to obtain the preset character group information corresponding to the trigger information input by the user. And inputting the preset character group information to the activated application;

If it is determined that the application information of the activated application is saved in the first shortcut input information, the trigger information input by the user and the preset character group corresponding to the application information are obtained by using the first shortcut input information. Information, and inputting the preset character group information to the activated application.
The method of claim 1 wherein:

The first shortcut input information is a first relationship mapping table including a mapping relationship between the application information, the trigger information, and the preset character group information; the second shortcut input information includes the trigger A second relationship mapping table of mapping relationship between the information and the preset character group information.
The method of claim 2 wherein:

The step of acquiring the preset character group information corresponding to the trigger information input by the user by using the second shortcut input information that has been saved in the mobile terminal includes:

The mobile terminal monitors trigger information input by the user;

When the trigger information is detected, the preset relationship group information corresponding to the trigger information is searched in the second relationship mapping table.
The method of claim 2 wherein:

The first relationship mapping table includes a relationship mapping table for regular input and a relationship mapping table for security input, where the trigger information and the application information input by the user are acquired by using the first shortcut input information. Before the step of corresponding preset character group information, the method further includes:

Monitoring the input method keyboard of the mobile terminal;

When it is detected that the local input method keyboard of the mobile terminal is activated, it is determined by the Entering a relationship mapping table, acquiring trigger information input by the user and preset character group information corresponding to the application information;

When the custom password keyboard of the activated application is started, it is determined that the trigger information input by the user and the preset character group information corresponding to the application information are obtained by the relationship mapping table for security input.
The method of claim 4 wherein:

The step of acquiring the trigger information input by the user and the preset character group information corresponding to the application information by using the first shortcut input information includes:

The mobile terminal monitors trigger information input by the user;

When the trigger information is detected, the trigger information and the preset character group information corresponding to the application information are searched in the relationship mapping table for the normal input or the relationship mapping table for the security input.
The method of claim 5 wherein:

The step of inputting the preset character group information to the activated application includes:

When the trigger information and the preset character group information corresponding to the application information are found in the relationship mapping table for the normal input, the found preset character group information is directly input to the activated application. Input method focus;

When the trigger information and the preset character group information corresponding to the application information are found in the relationship mapping table for security input, image analysis is performed on the image of the area where the custom password keyboard is located. The screen coordinates of each character in the preset character group information are found, and the virtual touch operation is sequentially performed on the custom password keyboard according to the obtained screen coordinates of each character, thereby implementing the shortcut input. Preset character group information.
A method according to any of claims 1-6, wherein:

The trigger information is information input by the user that is received by the mobile terminal when at least one trigger mode is activated;

The triggering method includes at least one of the following methods: fingerprint recognition, eye pattern or iris recognition, face recognition, blink recognition, fixed physical buttons, button combinations, gesture actions, and screen touch hands. Potential.
A device for inputting information on a mobile terminal, comprising:

The determining module is configured to obtain application information of the activated application of the mobile terminal, and determine whether the application information of the activated application has been saved in the first shortcut input information of the mobile terminal;

The first input module is configured to: when determining that the application information of the activated application is not saved in the first shortcut input information, acquire the trigger information input by the user by using the second shortcut input information that has been saved in the mobile terminal Corresponding preset character group information, and inputting the preset character group information to the activated application;

a second input module, configured to acquire trigger information input by the user and the application information by using the first shortcut input information when determining that the application information of the activated application has been saved in the first shortcut input information Corresponding preset character group information, and inputting the preset character group information to the activated application.
The device of claim 8 wherein:

The first shortcut input information is a first relationship mapping table including a mapping relationship between the application information, the trigger information, and the preset character group information; the second shortcut input information includes the trigger A second relationship mapping table of mapping relationship between the information and the preset character group information.
The device of claim 9 wherein:

The first relationship mapping table includes a relationship mapping table for regular input and a relationship mapping table for security input, if the determining module determines that the application information of the activated application has been saved in the first shortcut input information. The second input module monitors the input method keyboard of the mobile terminal, and when the local input method keyboard of the mobile terminal is detected to be activated, the relationship mapping table for regular input is used to obtain The trigger information input by the user and the preset character group information corresponding to the application information, when the custom password keyboard of the activated application is detected to be started, use the relationship mapping table for secure input to obtain user input. The trigger information and the preset character group information corresponding to the application information.