WO2013157626A1 - Electronic device and vibration control method - Google Patents

Abstract

An electronic device comprises a vibration unit that generates vibration, a display unit that has a display screen, an instruction position reception unit that receives the input of an instruction position on the display screen, a display image that is displayed on the display screen, and a vibration control unit that generates vibration control information for vibrating the vibration unit based on the instruction position received by the instruction position reception unit.

Description

Electronic device and vibration control method

The present invention relates to an electronic device and a vibration control method.
This application claims priority based on Japanese Patent Application No. 2012-096572 for which it applied on April 20, 2012, and uses the content here.

Conventionally, a portable information terminal including a touch panel and a vibration unit is known (for example, see Patent Document 1). The portable information terminal disclosed in Patent Literature 1 vibrates the vibration unit at a different level according to whether or not input is possible using a touch panel.

Japanese Unexamined Patent Publication No. 2010-152893

However, the drive unit of the portable information terminal disclosed in Patent Document 1 vibrates as a notification unit and cannot drive the housing according to the touch position on the touch panel.

An electronic device according to one embodiment of the present invention is displayed on the display screen, a vibration unit that generates vibration, a display unit including a display screen, an instruction position reception unit that receives an input of an instruction position on the display screen. And a vibration control unit that generates vibration control information for vibrating the vibration unit based on the displayed image and the designated position received by the designated position receiving unit.

In addition, an electronic device according to another aspect of the present invention includes a vibration unit that generates vibrations, a detection unit that detects movement of the device main body as an input operation for moving an indicated position on the display screen of another device, A communication unit that transmits the movement information detected by the detection unit to another device, and that receives a luminance value of a display image displayed on the display screen at an instruction position moved based on the movement information; And a vibration control unit that generates vibration control information for causing the vibration unit to vibrate according to the luminance value received by the communication unit.

A vibration control method according to another aspect of the present invention is a vibration control method for a vibration unit in an electronic apparatus having a display screen and a vibration unit, and receives an instruction position input on the display screen. And a vibration control information generation step for vibrating the vibration unit based on the display image displayed on the display screen and the indication position received by the indication position reception step. To do.

According to the aspect of the present invention, the housing can be driven according to the touch position on the touch panel. In other words, visual information can be converted into tactile information. Therefore, the user can feel the display image as a tactile sense in addition to the visual sense.

It is an example of the functional block diagram of the electronic device by the 1st Embodiment of this invention. It is a figure which shows an example of a display image. It is a figure which shows an example of the change of the luminance value on a display image, and a luminance value. It is a figure which shows an example of the time change of an input voltage and a vibration waveform. It is sectional drawing of the housing | casing for demonstrating the arrangement position of a vibration motor. It is a figure which shows an example of a time change of a drive waveform (input waveform) and a vibration waveform. It is sectional drawing of the housing | casing for demonstrating the arrangement position of a linear vibrator. It is a figure which shows an example of the time change of an input voltage and a vibration waveform. It is sectional drawing of the housing | casing for demonstrating the arrangement position of a voice coil motor. It is a figure which shows the other example of a time change of a luminance value, an input voltage, and a vibration waveform. It is a figure which shows the other example of a time change of a luminance value, an input voltage, and a vibration waveform. It is an example of the flowchart which shows the flow of a process of an electronic device. It is another example of the flowchart which shows the flow of a process of an electronic device. It is an example of the functional block diagram of the electronic device by the 2nd Embodiment of this invention. It is an example of the functional block diagram of the electronic device by the 3rd Embodiment of this invention. It is an example of the functional block diagram of the electronic device by the 4th Embodiment of this invention.

(First embodiment)
Hereinafter, a first embodiment of the present invention will be described with reference to the drawings. FIG. 1 is an example of a functional block diagram of an electronic device 1 according to the first embodiment of the present invention. As shown in FIG. 1, the electronic device 1 includes a main body (housing) 10, a display control unit 100, a display unit 110, a touch sensor (pointed position reception unit) 120, a vibration control unit 130, a vibration unit 140, and a storage unit. 190.

An example of the electronic device 1 is a camera, a smartphone, a tablet, a portable music playback device, or the like.

Note that the vibration unit 140 (the same applies to vibration units 240 and 340 described later) is an example of the drive unit of the present invention. Another example of the drive unit of the present invention is a position moving unit that moves the display screen in the thickness direction of the display unit 110. In other words, the electronic device 1 (the same applies to electronic devices 2, 3, and 4 described later) may include a position moving unit (not shown) instead of the vibrating unit 140 (vibrating units 240 and 340).

Further, when the electronic apparatus 1 includes a position moving unit (not shown) instead of the vibrating unit 140, a position moving unit (not shown) is used instead of the vibration control unit 130 (the same applies to vibration control units 230, 330, and 332 described later). ) Is provided. Hereinafter, the case where the electronic apparatus 1 includes the vibration unit 140 as illustrated in FIG. 1 will be described.

The display unit 110 has a display screen (not shown). Hereinafter, the information displayed on the display screen is also referred to as a display image. The basic data of the display image is stored in the storage unit 190.

The storage unit 190 stores various data. For example, the storage unit 190 stores basic data of the display image. An example of the basic data of the display image is bitmap information (for example, a photograph and an illustration) and screen information of a predetermined screen (for example, a menu screen and a help screen). Regarding the basic data of the display image stored in the storage unit 190, for convenience of explanation, “bit map information of A image” is also simply referred to as “A image”, and “screen information of B screen” is simply “B screen”. It shall also be called.

The image (bitmap information) stored in the storage unit 190 is not particularly limited. For example, the electronic device 1 includes a communication unit (not shown), and the storage unit 190 stores a received image received by the communication unit. Further, the electronic device 1 may include a medium connection unit (not shown), and the storage unit 190 may store an image in a medium (for example, a memory card) connected to the medium connection unit. The electronic device 1 may include an imaging unit (not shown), and the storage unit 190 may store a captured image captured by the imaging unit. Further, the electronic device 1 may include an image creation unit (drawing software), and the storage unit 190 may store the created image created by the image creation unit.

Further, the basic data of the display image is stored (saved) in the storage unit 190 in accordance with an explicit save instruction from the user at the time of shipment or after shipment, and is not based on the above-described save instruction after shipment. Is stored (temporarily stored) in the storage unit 190. For example, examples of display image base data temporarily stored in the storage unit 190 are a cache image, a cache screen, and a through image.

Touch sensor 120 detects the contact position on the display screen. That is, the touch sensor 120 accepts an input of the designated position on the display screen from the user. The touch sensor 120 outputs the contact position (instructed position) to the display control unit 100 when detecting the contact position on the display screen, that is, when receiving the input of the designated position.

The display control unit 100 displays the display image on the display screen based on the basic data of the display image stored in the storage unit 190. More specifically, the display control unit 100 generates display data based on the basic data of the display image stored in the storage unit 190 and outputs the generated display data to the display unit 110.

Note that there are various timings (or conditions) at which the display control unit 100 displays the display image on the display screen. For example, the display control unit 100 displays an image stored in the storage unit 190 in the past on the display screen when the user gives an instruction via the touch sensor 120. In addition, when an image is temporarily stored in the storage unit 190, the display control unit 100 displays the temporarily stored image on the display screen.

Further, the display control unit 100 acquires a contact position (instructed position) from the touch sensor 120. When the display control unit 100 acquires the contact position from the touch sensor 120, the display control unit 100 executes various processes according to the display image and the indicated position.

For example, when the display control unit 100 acquires a contact position from the touch sensor 120 during display of a certain screen, the contact position is on one button on the screen (in the button display area). In this case, a process ID corresponding to the button (identification information for identifying a process previously associated with the button) is output to a process execution unit (not shown). The process execution unit that has acquired the process ID from the display control unit 100 executes the process according to the process ID and outputs an instruction to display the process result to the display control unit 100. After outputting the process ID to the process execution unit, the display control unit 100 generates display data according to an instruction from the process execution unit, and outputs the generated display data to the display unit 110. Note that the display control unit 100 may execute a process according to the process ID instead of the process execution unit. That is, the display control unit 100 may have the function of a processing execution unit.

In addition, when the display control unit 100 acquires a contact position from the touch sensor 120 while displaying an image, the display control unit 100 outputs a luminance value at the contact position of the display image to the vibration control unit 130.

The vibration control unit 130 controls the vibration unit 140 by generating vibration control information and outputting the generated vibration control information to the vibration unit 140.

Specifically, the vibration control unit 130 generates vibration control information according to the display image and the contact position. More specifically, the vibration control unit 130 acquires a luminance value (luminance value at the contact position of the display image) from the display control unit 100. The vibration control unit 130 that has acquired the luminance value from the display control unit 100 generates vibration control information corresponding to the luminance value.

The vibration control unit 130 that has acquired the luminance value from the display control unit 100 calculates the difference between the luminance value (the luminance value acquired this time) and the luminance value acquired last time, and performs vibration control according to the difference in luminance value. Information may be generated. That is, the vibration control unit 130 may generate vibration control information according to whether or not the contact position is an edge portion of the display image.

The vibration unit 140 vibrates the main body (housing) 10 based on the vibration control information output from the vibration control unit 130. Since the vibration control information output from the vibration control unit 130 is generated according to the display image and the contact position as described above, in other words, the vibration unit 140 includes the display image and the designated position. Vibrates accordingly.

Specifically, when the vibration unit 140 acquires vibration control information according to the luminance value, the vibration unit 140 vibrates according to the vibration control information. Further, when the vibration unit 140 acquires vibration control information corresponding to the difference in luminance value, the vibration unit 140 vibrates according to the vibration control information. That is, the vibration unit 140 vibrates according to whether or not the contact position is an edge portion of the display image.

In addition, an example of the vibration unit 140 is a vibration motor or a linear vibrator. When a vibration motor and a linear vibrator are used as the vibration unit 140, the vibration control information is an input voltage for driving the vibration motor and the linear vibrator, or information (signal) for generating the input voltage. In FIG. 1 (the same applies to other drawings), the number of the vibrating units 140 illustrated is one, but the electronic device 1 (the same applies to electronic devices 2, 3, and 4 described later) includes two or more vibrating units 140. May be provided.

Hereinafter, the vibration of the housing 10 (specifically, the display screen) when a vibration motor is used as the vibration unit 140 will be described.

FIG. 2 is an example of a display image. FIG. 3 is an example of luminance values on the display image and changes in luminance values. FIG. 4 is an example of the time variation of the input voltage and the vibration waveform. FIG. 5 is a cross-sectional view of the housing 10 for explaining the arrangement position of the vibration motor. The vibration motor is a vibration element that is input with a direct current, and generates a vibration having a strength proportional to the input voltage.

FIG. 2 shows a display image P that is an example of a display image. The finger and an arrow 2, traces the upper straight line L represents (from the start position p ₀ to the end point position p _7, straight contact position moving) state. Each of the positions p exists on the straight line L.

FIG. 3A shows luminance values on a straight line L including each position p. As shown in FIG. 3A, the luminance value between the position p ₀ and the position p ₁ on the straight line L is B ₄ , the luminance value between the position p ₁ and the position p _{2 on} the straight line L is B ₁ , and the straight line L The luminance value between the upper position p ₂ and the position p ₃ is B ₃ , the luminance value between the position p ₃ and the position p ₄ on the straight line L is B ₂ , and the luminance value between the position p ₄ and the position p ₅ on the straight line L. It is assumed that the value is B ₃ , the luminance value between position p ₅ and position p ₆ on the straight line L is B ₁ , and the luminance value between position p ₆ and position p ₇ on the straight line L is B ₄ .

FIG. 3 (b), the upper straight line L shown in FIG. 2, at a constant rate over a m seconds, when traced with a finger (multiplied by m sec at a constant speed, the end position p ₇ from the start position p ₀ Time variation of the brightness value when the contact position is moved straight up to the present). That is, FIG. 3B shows a temporal change of the luminance value for m seconds.

According to FIG. 3B, when the contact start time is time T ₀ (zero seconds), the time change of the luminance value from time T ₀ (zero seconds) to time T ₇ (m seconds) is the time T _0. to time _{T 1} between the luminance value _{B 4,} the time _{T 1} ~ time _{T 2,} between the luminance value _{B 1,} time _{T 2,} to time _{T 3} between the luminance value _{B 3,} time _{T 3} to time _{T 4} between the luminance value B _2, the time _{T 4} ~ time _{T 5} between the luminance value _{B 3,} between times _{T 5} ~ time _{T 6} the luminance value _{B 1,} between times _{T 6} ~ time _{T 7} is the luminance value _{B 4.}

FIG. 4A shows an input voltage input to the vibration motor (vibration unit 140) shown in FIG. 5 when the finger is traced on the straight line L shown in FIG. The time change of (vibration element input voltage) is represented. That is, FIG. 4A shows the time change of the input voltage when the luminance value changes with time as shown in FIG.

FIG. 4B shows the vibration of the casing 10 by the vibration motor (vibration unit 140) shown in FIG. 5 when the finger is traced on the straight line L shown in FIG. It represents the time change of the waveform. That is, FIG. 4B shows the change over time of the vibration intensity of the housing 10 when the luminance value changes over time as shown in FIG. Note that the vibration frequency shown in FIG. 4B is determined by the vibration element forming the vibration motor.

According to FIG. 4B, when the contact start time is time T ₀ (zero seconds), the time change of the vibration waveform from time T ₀ (zero seconds) to time T ₇ (m seconds) is the time T _0. to time _{T 1} between the vibration intensity _{V 4,} while the time _{T 1} ~ time _{T 2,} the vibration intensity _{V 1,} time _{T 2,} to time _{T 3} between the vibration intensity _{V 3,} while the time _{T 3} to time _{T 4} vibration intensity V _2, between times _{T 4} ~ time _{T 5} vibration intensity _{V 3,} while the time _{T 5} ~ time _{T 6} between vibration intensity _{V 1,} the time _{T 6} ~ time _{T 7} is the vibration intensity _{V 4.}

That is, the vibration control unit 130 vibrates the vibration motor (vibration unit 140) with a vibration intensity proportional to the luminance value (vibration intensity obtained by multiplying the luminance value by a predetermined coefficient). The coefficient may be changed according to the pressure (contact area) at the time of contact. For example, the degree of amplification may be increased as the pressure is higher. Further, the coefficient may be changed according to the moving speed of the contact position.

Subsequently, the vibration of the housing 10 (specifically, the display screen) when a linear vibrator is used as the vibration unit 140 will be described. FIG. 6 is an example of a time change of the drive waveform (input waveform) and the vibration waveform. FIG. 7 is a cross-sectional view of the housing 10 for explaining the arrangement position of the linear vibrator. The linear vibrator is a vibration element that inputs at the vibration frequency itself, and generates vibration having a strength proportional to the input voltage.

FIG. 6A shows a drive waveform (vibration element) of the linear vibrator (vibration unit 140) shown in FIG. 7 when the finger is traced on the straight line L shown in FIG. Drive waveform) over time. That is, FIG. 6A shows the change over time of the drive waveform when the luminance value changes over time as shown in FIG. According to FIG. 6A, the amplitude of the drive waveform changes according to the change of the luminance value. Note that the drive waveform shown in FIG. 6A is obtained by, for example, AM modulating the vibration frequency (determined by the vibration element forming the linear vibrator).

FIG. 6B shows the vibration of the casing 10 by the linear vibrator (vibration unit 140) shown in FIG. 7 when the finger is traced on the straight line L shown in FIG. It represents the time change of the waveform. That is, FIG. 6B shows the change over time of the vibration intensity of the housing 10 when the luminance value changes over time as shown in FIG.

As shown in FIG. 6B, when a linear vibrator is used for the vibration unit 140, as in the case of using a vibration motor, the vibration control unit 130 has a linear vibrator (vibration unit) with a vibration intensity proportional to the luminance value. 140) is vibrated. In the case of using a linear vibrator, as in the case of using a vibration motor, the proportional coefficient may be changed according to the pressure (contact area) at the time of contact, or the proportional coefficient according to the moving speed of the contact position. May be changed.

Subsequently, the electronic device 1 includes a position moving unit (voice coil motor (VCM)) that moves the display screen in the thickness direction of the display unit 110 instead of the vibration unit 140 (for example, a vibration motor or a linear vibrator). Will be described. When a voice coil motor is used, vibration control information generated by a position movement control unit (not shown) is an input voltage for driving the voice coil motor or information (signal) for generating the input voltage.

FIG. 8 is an example of the time change of the input voltage and the vibration waveform. FIG. 9 is a cross-sectional view of the housing 10 for explaining the arrangement position of the voice coil motor. The voice coil motor is a vibration element that inputs at the vibration frequency itself, and generates vibration having a strength proportional to the input voltage. Voice coil motors can generate vibrations from direct current or very low frequencies. In FIG. 9, the number of voice coil motors illustrated is one, but the electronic device 1 (the same applies to electronic devices 2, 3, and 4 described later) may include two or more voice coil motors. .

FIG. 8A shows an input input to the voice coil motor (position moving unit) shown in FIG. 9 when the finger is traced on the straight line L shown in FIG. It shows the time change of voltage (vibration element input voltage). That is, FIG. 8A shows the time change of the input voltage when the luminance value changes with time as shown in FIG.

FIG. 8B shows the height of the display screen by the voice coil motor (position moving unit) shown in FIG. 9 when the finger is traced on the straight line L shown in FIG. This represents a change with time (position in the thickness direction). That is, FIG. 8B shows a change over time in the height of the display screen when the luminance value changes over time as shown in FIG.

As shown in FIG. 8B, when a voice coil motor is used as the position moving unit, the position moving control unit (not shown) moves the display screen to a height proportional to the luminance value. In the case of using a voice coil motor, as in the case of using a vibration motor or the like, the proportional coefficient may be changed according to the pressure at the time of contact (contact area), or according to the moving speed of the contact position, The proportionality coefficient may be changed.

Subsequently, a case where a threshold value is set for the luminance value will be described. FIG. 10 is another example of the time change of the luminance value, the input voltage, and the vibration waveform.

Specifically, FIG. 10A is a diagram in which a threshold value Th1, a threshold value Th2,..., A threshold value Th8 are added to the diagram of the change in luminance value over time shown in FIG.

FIG. 10B shows the change over time of the input voltage to the voice coil motor (vibration element) when the threshold value is set as shown in FIG. The input voltage shown in FIG. 10B includes the brightness values (brightness value B ₁ , brightness value B ₂ ,..., Brightness value B ₄ ) and threshold values (threshold value Th 1, threshold value Th ₂ ,...) Shown in FIG. The threshold value Th8) is determined based on the comparison result.

FIG. 10C shows a time change of the vibration waveform of the casing 10 by the vibration motor (vibration unit 140) shown in FIG. 5 when the input voltage changes with time as shown in FIG. 10B.

In the example of FIG. 10, the relationship between the luminance value and the vibration intensity is such that the vibration intensity is zero (no vibration) when the luminance value is less than the threshold Th1, and the vibration intensity when the luminance value is greater than or equal to the threshold Th1 and less than Th2. Is the intensity Lv1, the vibration intensity is the intensity Lv2 when the luminance value is the threshold Th2 or more and less than Th3, the vibration intensity is the intensity Lv3 when the luminance value is the threshold Th3 or more and less than Th4, and the luminance value is the threshold Th4 or more Th5. If the brightness value is less than or equal to threshold Th5 and less than Th6, the vibration intensity is set to intensity Lv5. If the brightness value is greater than or equal to threshold Th6 and less than Th7, the vibration intensity is set to intensity Lv6. When the luminance value is greater than or equal to the threshold Th7 and less than Th8, the vibration intensity is set as the intensity Lv7, and when the luminance value is the threshold Th8, the vibration intensity is set as the intensity Lv8. There.

That is, as shown in FIG. 10, the vibration motor (vibration unit 140) may vibrate the housing 10 with a predetermined vibration intensity according to a comparison result between the luminance value and the threshold value. The same applies to the case where a linear vibrator is used as the vibration unit 140. The same applies to the case where a position moving unit (voice coil motor) is used instead of the vibrating unit 140 (vibrating motor, linear vibrator).

In the example of FIG. 10, the interval (difference) between adjacent threshold values is constant, but the interval between adjacent threshold values may not be constant. In the example of FIG. 10, eight threshold values (threshold value Th1, threshold value Th2,..., Threshold value Th8) are used, but one to seven or nine or more threshold values may be used.

Subsequently, a case where a difference in luminance value is used will be described. FIG. 11 shows another example of temporal changes in the luminance value, input voltage, and vibration waveform.

Specifically, FIG. 11A shows a change in luminance value over time when the finger is traced on the straight line L shown in FIG. 2 at a constant speed over m seconds. That is, FIG. 11A shows the change over time in the difference in luminance value over the m seconds.

The input voltage in FIG. 11 (b) represents the change over time of the input voltage to the voice coil motor (vibration element) when the difference in luminance value changes over time as shown in FIG. 11 (a). The input voltage shown in FIG. 11B is determined based on the difference between the luminance values shown in FIG.

FIG. 11 (c) shows the time change of the vibration waveform of the housing 10 by the vibration motor (vibration unit 140) shown in FIG. 5 when the input voltage changes with time as shown in FIG. 11 (b).

It should be noted that the temporal change in the difference in luminance value from time T ₀ (zero seconds) to time T ₇ (m seconds) in FIG. 11A changes as follows. That is, in FIG. 11A, the difference in luminance value at time T ₁ (at the time of contact at position p ₁ ) is B _d3 (= B ₄ −B ₁ ), and at time T ₂ (at the time of contact at position p ₂ ). The difference in luminance value is B _d2 (= B ₃ −B ₁ ), and the difference in luminance value at time T ₃ (at the time of contact at position p ₃ ) is B _d1 (= B ₃ −B ₂ ), and time T ₄ ( The difference in luminance value at the time of contact at position p ₄ is B _d1 (= B ₃ −B ₂ ), and the difference in luminance value at time T ₅ (at the time of contact at position p ₅ ) is B _d2 (= B ₃ −B). ₁ ), and the difference in brightness value B at time T ₆ (when the position p ₆ is touched) is _d3 (= B ₄ −B ₁ ), and the difference in brightness value at times other than the above from time T ₀ to time T _7. Becomes zero.

That is, the vibration motor (vibration unit 140) may vibrate the housing 10 with a predetermined vibration intensity according to the difference in luminance value. In other words, the vibration motor (vibration unit 140) may drive the housing 10 according to whether or not the indicated position is the edge portion of the display image, or to what extent the position is applied to the edge portion. The same applies to the case where a linear vibrator is used as the vibration unit 140. The same applies to the case where a position moving unit (voice coil motor) is used instead of the vibrating unit 140 (vibrating motor, linear vibrator).

It should be noted that a threshold value may be set for the difference in luminance value and the housing 10 may be driven (vibration, the height of the display screen is moved). That is, the vibration motor (vibration unit 140) may vibrate the housing 10 with a predetermined vibration intensity according to the comparison result between the difference in luminance value and the threshold value. The same applies to the case where a linear vibrator is used as the vibration unit 140. The same applies to the case where a position moving unit (voice coil motor) is used instead of the vibrating unit 140 (vibrating motor, linear vibrator).

2 to 11, for convenience, the case where the contact position on the display screen is moved at a constant speed is described. However, the same applies to the case where the movement speed of the contact position is not constant. 2 to 11, the case where the contact position is linearly moved is described for convenience, but the same applies to the case where the contact position is not linearly moved.

FIG. 12 is an example of a flowchart showing a processing flow of the electronic device 1. FIG. 13 is another example of a flowchart showing the flow of processing of the electronic device 1.

Specifically, FIG. 12 shows a flow of processing (one example) when a touch is detected by the touch sensor 120 in any of the following situations 1, 2 and 3. FIG. 13 illustrates a process flow (one example) when a touch is detected by the touch sensor 120 in any of the following situations 1 and 2. The flowcharts shown in FIGS. 12 and 13 are started when a display image is displayed.

Situation 1: Transition from non-contact state to contact state (start of finger contact)
Situation 2: Change in contact position (movement of the position of the finger in contact)
Situation 3: Contact at the same contact position (finger contact at the same position)

In FIG. 12, the touch sensor 120 determines whether or not contact on the display screen has been detected (step S100). Note that the touch sensor 120 detects contact in the case of any of the above-described situation 1, situation 2, and situation 3.

When the contact is detected in step S100 (step S100: Yes), that is, in the case of any one of situation 1, situation 2, and situation 3, the touch sensor 120 outputs the contact position to the display control unit 100. Display control part 100 which acquired a contact position from touch sensor 120 judges whether a contact position is the same as the last time (Step S102). That is, the display control unit 100 determines whether the situation 1, the situation 2, or the situation 3 is the situation 1, the situation 2, or the situation 3.

In step S102, when the contact position is not the same as the previous time (step S102: No), that is, in the case of situation 1 or situation 2, the brightness value of the contact position of the display image (that is, the display image and the designated position). A corresponding luminance value) is output to the vibration control unit 130.

The vibration control unit 130 that has acquired the luminance value from the display control unit 100 generates vibration control information (an input voltage for driving a vibration motor or a linear vibrator or an input voltage corresponding to the display image and the contact position). Information) is generated (step S110). For example, the vibration control unit 130 generates vibration control information according to the luminance value acquired from the display control unit 100 (the luminance value at the contact position of the display image). Further, the vibration control unit 130 may generate vibration control information according to a difference between the previous luminance value acquired from the display control unit 100 and the current luminance value acquired from the display control unit 100. That is, the vibration control unit 130 may generate vibration control information according to whether or not the contact position is an edge portion of the display image. The vibration control unit 130 outputs the generated vibration control information to the vibration unit 140. The vibration unit 140 that has acquired the vibration control information from the vibration control unit 130 vibrates the main body (housing) 10 according to the vibration control information (step S120).

On the other hand, when the contact position is the same as the previous time in step S102 (step S102: Yes), that is, in the case of situation 3, it is determined whether or not the housing 10 is vibrating (step S130). For example, the vibration control unit 130 determines that the housing 10 is vibrating after outputting the vibration control information for vibrating the housing 10 and before outputting the vibration control information for stopping the vibration.

In step S130, when the housing 10 is not vibrating (step S130: No), the process proceeds to step S160. If the housing 10 is vibrating in step S130 (step S130: Yes), it is determined whether or not a predetermined time has elapsed from the start of the vibration (step S132). For example, when a predetermined time has passed since the vibration control information (excluding vibration control information for stopping vibration) is output to the vibration unit 140 at the last (most recent time), the vibration control unit 130 performs predetermined processing from the start of the vibration. Judge that time has passed.

If the predetermined time has not elapsed in step S132 (step S132: No), the process proceeds to step S160. When the predetermined time has elapsed in step S132 (step S132: Yes), the vibration of the housing 10 is stopped (step S134). For example, the vibration control unit 130 outputs vibration control information for stopping the vibration to the vibration unit 140.

On the other hand, if no contact is detected in step S100 (step S100: No), that is, if it is in a non-contact state, as in step S130, it is determined whether the housing 10 is vibrating (step S130). Step S150). If the housing 10 is vibrating in step S150 (step S150: Yes), the vibration of the housing 10 is stopped (step S154), as in step S134.

Subsequent to step S120, step S130 (No), step S132 (No), step S134, step S150 (No), or step S154, the display control unit 100 determines whether or not display of the display image has ended (step S120). Step S160). If the display has not ended (step S160: No), the process returns to step S100.

On the other hand, when the display is finished (step S160: Yes), it is determined whether the housing 10 is vibrating as in step S130 (step S170). When the casing 10 is vibrating in step S170 (step S170: Yes), the vibration of the casing 10 is stopped (step S174) as in step S134, and the flowchart shown in FIG. On the other hand, when the casing 10 is not vibrating in step S170 (step S170: No), step S174 is skipped and the flowchart shown in FIG.

In FIG. 13, the touch sensor 120 determines whether or not contact on the display screen has been detected (step S202). Note that the touch sensor 120 detects a contact when the situation 1 or the situation 2 is described above. In the case of situation 3 described above, no contact is detected.

When a contact is detected in step S202 (step S202: Yes), that is, in the case of either situation 1 or situation 2, the touch sensor 120 outputs the contact position to the display control unit 100. The display control unit 100 that has acquired the contact position from the touch sensor 120 outputs the luminance value of the contact position of the display image (that is, the luminance value according to the display image and the designated position) to the vibration control unit 130.

The vibration control unit 130 that has acquired the luminance value from the display control unit 100 generates vibration control information according to the display image and the contact position (step S210). For example, the vibration control unit 130 generates vibration control information according to the luminance value acquired from the display control unit 100 (the luminance value at the contact position of the display image). Further, the vibration control unit 130 may generate vibration control information according to a difference between the previous luminance value acquired from the display control unit 100 and the current luminance value acquired from the display control unit 100. That is, the vibration control unit 130 may generate vibration control information according to whether or not the contact position is an edge portion of the display image. The vibration control unit 130 outputs the generated vibration control information to the vibration unit 140. The vibration unit 140 that has acquired the vibration control information from the vibration control unit 130 vibrates the main body (housing) 10 according to the vibration control information (step S220).

On the other hand, when no contact is detected in step S202 (step S202: No), that is, in the case of the situation 3 or the non-contact state, it is determined whether or not the housing 10 is vibrating (step S230). . For example, the vibration control unit 130 determines that the housing 10 is vibrating after outputting the vibration control information for vibrating the housing 10 and before outputting the vibration control information for stopping the vibration.

In step S230, when the housing 10 is not vibrating (step S230: No), the process proceeds to step S260. If the casing 10 is vibrating in step S230 (step S230: Yes), it is determined whether or not a predetermined time has elapsed since the start of the vibration (step S232). For example, when a predetermined time has passed since the vibration control information (excluding vibration control information for stopping vibration) is output to the vibration unit 140 at the last (most recent time), the vibration control unit 130 performs predetermined processing from the start of the vibration. Judge that time has passed.

If the predetermined time has not elapsed in step S232 (step S232: No), the process proceeds to step S260. When the predetermined time has elapsed in step S232 (step S232: Yes), the vibration of the housing 10 is stopped (step S234). For example, the vibration control unit 130 outputs vibration control information for stopping the vibration to the vibration unit 140.

Following step S220, step S230 (No), step S232 (No), or step S234, the display control unit 100 determines whether or not display of the display image has ended (step S260). If the display has not ended (step S260: No), the process returns to step S202.

On the other hand, when the display is completed (step S260: Yes), it is determined whether the housing 10 is vibrating as in step S230 (step S270). If the housing 10 is vibrating in step S270 (step S270: Yes), the vibration of the housing 10 is stopped (step S274) as in step S234, and the flowchart shown in FIG. On the other hand, when the housing 10 is not vibrating in step S270 (step S270: No), step S274 is skipped and the flowchart shown in FIG.

Note that the flowcharts shown in FIGS. 12 and 13 show the case where the electronic device 1 uses the vibration unit 140 (vibration motor, linear vibrator) as a drive unit, that is, according to the luminance value (or luminance value difference). 10 shows the flow of processing in the case of vibrating 10. However, when the electronic device 1 uses a position moving unit (voice coil motor) as a driving unit, that is, when the display screen is moved in the thickness direction of the housing 10 in accordance with the luminance value (or luminance value difference). Is the same.

As described above, according to the electronic apparatus 1, the housing 10 can be driven according to the luminance value (or the difference in luminance value) at the contact position. For example, when the vibration unit 140 (vibration motor, linear vibrator) is used as the drive unit, the housing 10 can be vibrated according to the luminance value (or the difference in luminance value) at the contact position. Further, when a position moving unit (voice coil motor) is used as the driving unit, the height of the display screen can be changed according to the luminance value (or luminance value difference) at the contact position. That is, the electronic device 1 converts visual information into tactile information. Therefore, the user can recognize the image as a tactile sense in addition to the visual sense.

(Second Embodiment)
The second embodiment of the present invention will be described below with reference to the drawings. FIG. 14 is an example of a functional block diagram of the electronic device 2 according to the second embodiment of the present invention. As shown in FIG. 14, the electronic device 2 includes a main body (housing) 20 including a display control unit 200, a display unit 210, a keyboard 220, a vibration control unit 230, a vibration unit 240, and a storage unit 290.

The keyboard 220 includes a pressing key unit 222 and a cursor pad (instructed position receiving unit) 224. The push key unit 222 has a plurality of buttons. The cursor pad 224 is an example of a pointing device for moving the designated position on the display screen. An example of the electronic device 2 is a notebook computer or a notebook computer.

Since the display unit 210, the vibration control unit 230, the vibration unit 240, and the storage unit 290 included in the electronic device 2 are the same as the display unit 110, the vibration control unit 230, the vibration unit 140, and the storage unit 190 included in the electronic device 1, A part or all of the description is omitted. The vibrating unit 240 is an example of the driving unit of the present invention. The electronic device 2 may include a position moving unit that moves the display screen in the thickness direction of the display unit 210 as a driving unit instead of the vibration unit 240.

When the button of the pressing key unit 222 is pressed, the keyboard 220 outputs pressing information (information for identifying the button) to the display control unit 200. In addition, when the cursor pad 224 is operated, the keyboard 220 outputs operation information (operation direction and operation amount) to the display control unit 200. The cursor pad 224 outputs the operation information to the display control unit 200 when receiving an input of the designated position.

The display control unit 200 displays a display image on the display screen, similarly to the display control unit 100 included in the electronic device 1. Further, the display control unit 200 displays a cursor (pointer) indicating the designated position on the display screen.

Further, when the display control unit 200 acquires the pressing information from the keyboard 220, the display control unit 200 outputs a processing ID corresponding to the pressed button to a processing execution unit (not shown). The process execution unit that has acquired the process ID from the display control unit 200 executes the process according to the process ID, and outputs an instruction to display the process result to the display control unit 200. After outputting the process ID to the process execution unit, the display control unit 200 generates display data in accordance with an instruction from the process execution unit, and outputs the generated display data to the display unit 210. Note that the display control unit 200 may execute the process according to the process ID instead of the process execution unit. That is, the display control unit 200 may have the function of a process execution unit.

In addition, when the display control unit 200 acquires operation information from the keyboard 220 while displaying an image, the display control unit 200 moves the cursor according to the operation information. That is, the cursor pad 224 provided in the keyboard 200 is a pointing device for moving the designated position on the display screen.

Further, the display control unit 200 displays the cursor position of the display image when the cursor is displayed or when the cursor position is moved while the image is displayed (when operation information is acquired from the keyboard 220). The luminance value is output to the vibration control unit 230.

The vibration control unit 230 acquires a luminance value (luminance value at the cursor position of the display image) from the display control unit 200. The vibration control unit 230 that has acquired the luminance value from the display control unit 200 generates vibration control information corresponding to the luminance value.

The vibration control unit 230 that has acquired the luminance value from the display control unit 200 calculates a difference between the luminance value (the luminance value acquired this time) and the luminance value acquired last time, and performs vibration control according to the difference in luminance value. Information may be generated. That is, the vibration control unit 230 may generate vibration control information according to whether or not the cursor position is an edge portion of the display image.

As described above, according to the electronic device 2, the housing 20 can be driven according to the luminance value (or luminance value difference) at the cursor position. For example, when the vibration unit 240 (vibration motor or linear vibrator) is used as the drive unit, the housing 20 can be vibrated according to the luminance value (or the difference in luminance value) at the cursor position. When a position moving unit (voice coil motor) is used as the driving unit, the height of the display screen can be changed according to the luminance value (or luminance value difference) at the cursor position. That is, the electronic device 2 converts visual information into tactile information. Therefore, the user can recognize the image as a tactile sense in addition to the visual sense.

(Third embodiment)
The third embodiment of the present invention will be described below with reference to the drawings. FIG. 15 is an example of a functional block diagram of the electronic device 3 according to the third embodiment of the present invention. As shown in FIG. 15, the electronic device 3 includes a main body (housing) 30a, a keyboard 30b, a mouse 30c, and a display 30d.

The main body (housing) 30a includes a display control unit 300, a vibration control unit 330, a communication unit 380, and a storage unit 390. The keyboard 30b includes a push key unit 322 and a communication unit 382. The mouse 30c includes a detection unit 326, a vibration unit 340, and a communication unit 384. The display 30d includes a display screen 312 and a communication unit 386. The mouse 30c is an example of a pointing device for moving the designated position on the display screen 312. An example of the electronic device 3 is a desktop personal computer.

Since the display control unit 300, the vibration control unit 330, and the storage unit 390 included in the main body 30a of the electronic device 3 are the same as the display control unit 200, the vibration control unit 230, and the storage unit 290 included in the electronic device 2, one description will be given. Some or all of them are omitted. Since the keyboard 30b of the electronic device 3 is the same as the keyboard 220 provided in the electronic device 2 except that the keyboard 30b is provided with a communication unit 382 instead of the cursor pad 224, description thereof is omitted. The display 30d of the electronic device 3 will not be described regarding the same contents as the display unit 210 provided in the electronic device 2. The vibrating unit 340 is an example of the driving unit of the present invention. The electronic device 3 may include a position moving unit that moves the display screen 312 in the thickness direction of the display 30d as a driving unit instead of the vibration unit 340.

The detecting unit 326 detects the movement of the own device (device main body, mouse 30c) as an input operation for moving the indicated position on the display screen of the display 30d. The communication unit 384 transmits the movement information (movement direction and movement amount) detected by the detection unit 326 to the main body 32a. In other words, when movement is detected by the detection unit 326, the mouse 30c outputs movement information (movement direction and movement amount) to the main body 30a via the communication unit 384.

Further, the communication unit 384 receives vibration control information from the main body 30a. The vibration unit 340 vibrates according to the vibration control information received by the communication unit 384. In other words, the mouse 30c vibrates the vibration unit 340 according to the vibration control information acquired from the main body 30a.

The display control unit 300 displays a display image on the display screen 312 in the same manner as the display control unit 200 included in the electronic device 2. In addition, the display control unit 300 displays a cursor (pointer) indicating the designated position on the display screen 312, similarly to the display control unit 200 included in the electronic device 2.

In addition, when the display control unit 300 acquires the pressing information from the keyboard 30b via the communication unit 380, the display control unit 300 assigns the processing ID corresponding to the pressed button to the processing execution unit, similarly to the display control unit 200 included in the electronic device 2. (Not shown), generates display data in accordance with an instruction from the processing execution unit, and outputs the display data to the display 30d via the communication unit 380. Note that the display control unit 300 may also have the function of a process execution unit.

When the display control unit 300 acquires movement information from the mouse 30c via the communication unit 380 during display of a certain image, the display control unit 300 performs a cursor according to the movement information in the same manner as the display control unit 200 provided in the electronic device 2. Move. That is, the detection unit 328 included in the mouse 30c is a pointing device for moving the designated position on the display screen 312.

Further, the display control unit 300 includes a display control unit included in the electronic device 2 when a cursor is displayed during display of a certain image or when the cursor position is moved (when movement information is acquired from the mouse 30c). Similarly to 200, the luminance value at the cursor position of the display image is output to the vibration control unit 330.

The vibration control unit 330 acquires the luminance value (the luminance value at the cursor position of the display image) from the display control unit 300. The vibration control unit 330 that has acquired the luminance value from the display control unit 300 generates vibration control information corresponding to the luminance value.

The vibration control unit 330 that has acquired the luminance value from the display control unit 300 calculates a difference between the luminance value (the luminance value acquired this time) and the luminance value acquired last time, and performs vibration control according to the difference in luminance value. Information may be generated. That is, the vibration control unit 330 may generate vibration control information according to whether or not the cursor position is an edge portion of the display image.

The vibration control unit 330 that has generated the vibration control information outputs the vibration control information to the mouse 30c via the communication unit 380.

As described above, according to the electronic device 3, the mouse 30c can be driven in accordance with the luminance value (or luminance value difference) at the cursor position. For example, when the vibration unit 340 (vibration motor, linear vibrator) is used as the drive unit, the mouse 30c can be vibrated according to the luminance value (or the difference in luminance value) at the cursor position. Further, when a position moving unit (voice coil motor) is used as the driving unit, the height of the mouse 30c (for example, the height of the upper portion relative to the bottom of the mouse 30c) according to the luminance value (or luminance value difference) at the cursor position. Can be changed. That is, the electronic device 3 converts visual information into tactile information. Therefore, the user can recognize the image as a tactile sense in addition to the visual sense.

(Fourth embodiment)
The fourth embodiment of the present invention will be described below with reference to the drawings. FIG. 16 is an example of a functional block diagram of the electronic device 4 according to the fourth embodiment of the present invention. As shown in FIG. 16, the electronic device 4 includes a main body (housing) 32a, a keyboard 30b, a mouse 32c, and a display 30d.

The electronic device 4 includes the vibration control unit 332 not in the main body 32a but in the mouse 32c, whereas the electronic device 3 includes the vibration control unit 330 in the main body 30a. In the embodiment described above, the vibration control unit 330 is provided in the main body 30a, whereas in the present embodiment, the vibration control unit 332 is provided in the mouse 32c. Note that in the electronic device 4, the same reference numerals as those of the electronic device 3 are the same as those of the electronic device 3, and thus a part or all of the description is omitted.

The communication unit 384 of the mouse 32c transmits the movement information (movement direction and movement amount) detected by the detection unit 326 to the main body 32a. The communication unit 384 receives a luminance value from the main body 32a. The luminance value received by the communication unit 384 from the main body 32a is the luminance value of the display image at the designated position moved by the main body 32a based on the movement information. That is, the display control unit 300 of the main body 32a acquires the movement information from the mouse 32c via the communication unit 381, moves the designated position based on the movement information, and sets the luminance value of the display image at the designated position after the movement. The data is transmitted to the mouse 32c via the communication unit 381.

The communication unit 384 outputs the luminance value received from the main body 32 a to the vibration control unit 332.

The vibration control unit 332 that has received the luminance value from the main body 32a performs vibration control according to the vibration control information corresponding to the luminance value (or the difference between the luminance value (the luminance value acquired this time) and the luminance value acquired last time). Information). The vibration control unit 332 that has generated the vibration control information outputs the vibration control information to the vibration unit 340. That is, the vibration unit 340 vibrates according to the luminance value received by the communication unit 384.

In the fourth embodiment (the same applies to the third embodiment), the main body 32a, the keyboard 30b, the mouse 32c, and the display 30d are collectively referred to as the electronic device 4. However, the main body 32a, the keyboard 30b, the mouse 32c, and the display 30d, which are each element, may also be referred to as electronic devices. As described above, the mouse 32c, which is an electronic device, detects the movement of its own device (device main body, mouse 32c) as an input operation for moving the indicated position on the display screen of another device (display 30d). And transmitting the movement information detected by the detection unit 326 to another device (main body 32) and receiving the luminance value of the display image displayed on the display screen at the indicated position moved based on the movement information. Unit 384 and a vibration unit 340 that vibrates according to the luminance value received by communication unit 384.

As mentioned above, according to the electronic device 4, the same effect as the electronic device 3 can be acquired.

As described above, according to the electronic devices 1 to 4 according to the embodiment of the present invention, visual information is converted into tactile information. Therefore, the user can recognize the image as a tactile sense in addition to the visual sense.

Note that a program for executing each process of the electronic devices 1 to 4 according to the embodiment of the present invention is recorded on a computer-readable recording medium, and the program recorded on the recording medium is read into a computer system and executed. By doing so, you may perform the various process which concerns on each process of the electronic devices 1 to 4 by embodiment of this invention. Here, the “computer system” may include an OS and hardware such as peripheral devices. Further, the “computer system” includes a homepage providing environment (or display environment) if a WWW system is used. The “computer-readable recording medium” refers to a floppy (registered trademark) disk, a magneto-optical disk, an SD card, a writable nonvolatile memory such as a flash memory, a portable medium such as a CD-ROM, and a computer system. A built-in storage device such as a hard disk.

Further, the “computer-readable recording medium” means a volatile memory (for example, DRAM (Dynamic DRAM) in a computer system that becomes a server or a client when a program is transmitted through a network such as the Internet or a communication line such as a telephone line. Random Access Memory)), etc., which hold programs for a certain period of time. The program may be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium or by a transmission wave in the transmission medium. Here, the “transmission medium” for transmitting the program refers to a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line. The program may be for realizing a part of the functions described above. Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer system, and what is called a difference file (difference program) may be sufficient.

As described above, the embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and includes a design and the like within the scope not departing from the gist of the present invention.

In one embodiment, the electronic device includes a display unit having a display screen, an instruction position reception unit that receives an input of an instruction position on the display screen, a display image displayed on the display screen, and the instruction position reception A drive unit that drives the housing in accordance with the indicated position received by the unit.

The drive unit can drive the housing in accordance with the luminance value at the indicated position.

The drive unit can drive the housing depending on whether or not the indicated position is an edge portion of the display image.

The drive unit can vibrate the display screen or move the display screen in the thickness direction of the display unit.

The indication position receiving unit may be a sensor that detects a contact position on the display screen as the indication position.

The pointing position receiving unit may be a pointing device that operates the pointing position on the display screen.

In one embodiment, the electronic device receives, as an input operation for moving the designated position on the display screen of another device, a detection unit that detects the movement of the device itself, and movement information detected by the detection unit as another device. A communication unit that receives the luminance value of the display image displayed on the display screen at the indicated position moved based on the movement information, and a housing according to the luminance value received by the communication unit And a drive unit for driving the motor.

In one embodiment, the drive control method is a drive control method of a housing in an electronic device having a display screen and a drive unit, and includes an indication position receiving unit that receives an input of an indication position on the display screen, and the display Drive control means for driving the drive unit in accordance with the display image displayed on the screen and the designated position received by the designated position accepting means;

1, 2, 3, 4 ... electronic devices 10, 20, 30a, 32a ... main body (housing) 30b ... keyboard 30c, 32c ... mouse (own device, device main body, designated position receiving unit) 30d ... display 100 ... display control Unit 110 ... Display unit 120 ... Touch sensor (indicated position receiving unit) 130 ... Vibration control unit (drive control unit) 140 ... Vibration unit (drive unit) 190 ... Storage unit 200 ... Display control unit 210 ... Display unit 220 ... Keyboard 222 ... press key part 224 ... cursor pad (instructed position receiving part) 230 ... vibration control part (drive control part) 240 ... vibration part (drive part) 290 ... storage part 300 ... display control part 312 ... display screen 322 ... press key part 326: detection unit 330, 332: vibration control unit (drive control unit) 340: vibration unit (drive unit) 380, 81,382,384,386 ... communication unit 390 ... storage unit

Claims (10)

1. A vibration part that generates vibration;
   A display unit having a display screen;
   An indicated position receiving unit for receiving an input of an indicated position on the display screen;
   A vibration control unit that generates vibration control information for causing the vibration unit to vibrate based on the display image displayed on the display screen and the indication position received by the indication position reception unit. Electronic equipment.
2. The electronic device according to claim 1,
   The vibration control unit
   The electronic device, wherein the vibration control information is generated according to a luminance value at the indicated position.
3. The electronic device according to claim 2,
   The electronic apparatus according to claim 1, wherein the vibration control information is generated according to a time change of the luminance value when the indicated position moves on the display screen.
4. The electronic device according to claim 2,
   When the indicated position moves on the display screen, the vibration control is performed in accordance with a change over time in the difference between the luminance value at the previous indicated position received by the indicated position receiving unit and the luminance value at the current indicated position. An electronic device characterized by generating information.
5. The electronic device according to claim 1,
   The vibration control unit
   The electronic apparatus according to claim 1, wherein the vibration control information is generated according to whether the designated position is an edge portion of the display image.
6. The electronic device according to any one of claims 1 to 5,
   The said vibration part moves the said display screen to the thickness direction of the said display part by the generated vibration. The electronic device characterized by the above-mentioned.
7. The electronic device according to any one of claims 1 to 6,
   The indicated position receiving unit
   An electronic device, wherein the electronic device is a sensor that detects a contact position on the display screen as the indication position.
8. The electronic device according to any one of claims 1 to 6,
   The indicated position receiving unit
   An electronic device that is a pointing device that operates the indicated position on the display screen.
9. A vibration part that generates vibration;
   As an input operation for moving the indicated position on the display screen of another device, a detection unit that detects the movement of the device body,
   A communication unit that transmits the movement information detected by the detection unit to another device, and that receives the luminance value of the display image displayed on the display screen at the indicated position moved based on the movement information;
   A vibration control unit that generates vibration control information for vibrating the vibration unit according to the luminance value received by the communication unit;
   An electronic device comprising:
10. A vibration control method for a vibration part in an electronic device having a display screen and a vibration part,
    An instruction position receiving step for receiving an input of an instruction position on the display screen;
    Vibration control comprising: a vibration control information generation step for vibrating the vibration unit based on the display image displayed on the display screen and the indication position received by the indication position reception step. Method.

Images