WO2014040809A1

WO2014040809A1 - Arranging of indicators in a head-mounted display

Info

Publication number: WO2014040809A1
Application number: PCT/EP2013/066805
Authority: WO
Inventors: Felix Lauber; Felix Schwarz
Original assignee: Bayerische Motoren Werke Aktiengesellschaft
Priority date: 2012-09-11
Filing date: 2013-08-12
Publication date: 2014-03-20
Also published as: DE102012216057A1

Abstract

The invention relates to a method for arranging indicators in a head-mounted display worn by a user, comprising: displaying an indicator (8) of a first category in a first predetermined region (2) of the field of view (1) of the head-mounted display; detecting a predetermined viewing direction of the user; closing the display of the indicator (8) of the first category in the first predetermined region (2) of the field of view (1) of the head-mounted display, in response to the detecting of the predetermined movement; displaying the indicator (8) of the first category in a second predetermined region (3, 4) of the field of view of the head-mounted display.

Description

Arrange displays in a head-mounted display

The invention relates to a method for arranging displays in a user-mounted head-mounted display and a correspondingly configured device. Nowadays, head-mounted displays, sometimes called data glasses, are known. Helmet-mounted displays are also attributed to the head-mounted displays. Head-mounted displays are carried by a user on the head and arrange one or more displays in front of one or both eyes of the user. These displays may be transparent or at least semi-transparent, so that the user can see both the real environment and the displayed indicators or displays, such as a speedometer. The area in which head-mounted displays can display to a user is called field of view, sometimes called field-of-view.

It is known from the prior art to display the displays of a head-mounted display fixed, sometimes also called screen stabilized or head stabilized. They are then independent of the viewing direction of the user and remain even when changing the viewing direction at the same display location. For this type of representation, no detection of the viewing direction of the user is required, in other words: there is no tracking of the viewing direction required. Especially in the case of transparent displays, this type of display can be disturbing for the user since the displays can cover important information of the real environment. A similar effect also occurs with opaque displays, if on the display also pictures of the environment are displayed. Furthermore, this type of representation is particularly suitable for information that has no local context reference. Without tracking there is no way to display content in a fixed location in the environment (= local context reference), such as a navigation instruction on the road, the name of another road user above his car, additional information about a traffic sign at the position of the sign. Furthermore, it is known from the prior art to adapt the displays of a head-mounted display to the viewing direction in such a way that they appear to be stationary for the user at a location in the room. For transparent displays, the displays for a user appear to be fixed in place of the real environment. For this purpose, the viewing direction of the user must be recorded and the location of the display in the display must be adjusted accordingly.

It is also known from the prior art to display advertisements analogous to objects of the real environment, which is sometimes also called augmented reality. For this purpose, in addition to the viewing direction of the user, the position of the real objects must also be recorded continuously. In this way, additional information can be displayed, for example, to other road users or buildings. In the realization of such contact-analogue displays the current state of the art often involves the problem that the tracking of the viewing direction as well as of the objects is associated with a high delay for human perception. This manifests itself in the fact that the display "follows" in the event of rapid changes in the viewing direction or the position of the tracked object Perception is usually not accurate enough, so contact analog ads may appear "slipped". In the typical case that the user is the driver of a motor vehicle, unconsciously minimal (and unrecorded) head movements are often performed. This often causes displayed displays to "jiggle" or "shake" for the user of the head-mounted display. This problem is exacerbated by vehicle-borne vehicle movements or other acceleration forces transmitted to the driver. Especially for displays in the peripheral field of vision of the user, this can be very distracting for the user, since there movements are perceived very strongly.

The task to the person skilled in the art is the improvement of the type of display or display of displays in a head-mounted display. The object is achieved by the method according to claim 1 and the device according to claim 10. Advantageous developments are defined in the dependent claims.

Disclosed is a method of arranging displays in a user-carried head-mounted display, comprising: displaying a display of a first category in a first predetermined area of the field of view of the head-mounted display; Detecting a predetermined viewing direction of the user; Stopping the display of the first category display in the first predetermined area of the field of view of the head-mounted display in response to detecting the predetermined movement; Displaying the display of the first category in a second predetermined area of the field of view of the head-mounted display.

In the event that the display is displayed in the first predetermined area of the field of view at a specific location regardless of the viewing direction of the user, in other words: stationary with respect to the field of view, it may occur that important to the user in certain directions Information will be covered by an ad in the first area. The disclosed method allows the display to not obscure this important information by moving the display to a second area, that is, displaying it there in a stationary manner. In other words, the display is moved to where it does not prevent the unobstructed view of objects of the vehicle (for example speed displays) or the environment. It is envisaged to choose the first area such that a display in the first area disturbs the view of the user in a viewing direction or a range of viewing directions that is taken most of the time as little as possible, and the second area so to choose that a display in the second area as little as possible disturbs the view of the user on a particular object. For example, if the user is the driver of a motor vehicle, the first area may be optimized for looking forward to the road and the displays may not be located in an area of the head-mounted display through which the user looks at the road. If, on the other hand, the user is looking in the direction of a speed indicator permanently installed in the vehicle, the shift of the displays in the Head-mounted display which allows free view of the speedometer through the display of the head-mounted display. The display of the head-mounted display is shifted from the first area to a second area when it is detected that the user is looking in the direction of the speed display. Another example is the user's gaze into an exterior mirror of a motor vehicle. If it is recognized from the viewing direction that the driver is looking into an exterior mirror of a motor vehicle, displays displayed in the first area can be shifted into a second area, so that the driver's unobstructed view of the exterior mirror is not disturbed by the display. The second area may be located in the peripheral viewing area of the user and thus, depending on the dimensioning of the field of view of the display, in an edge area of the field of view of the display (the edge area need not touch the edge of the display).

In the event that the display is displayed adapted to the line of sight so that it appears to the user at a fixed location in the room or appears to be associated with the location of a detected object for the user, the user is allowed to pass through the ad is not distracted. For the driver of a motor vehicle, for example, a fixed display or contact-analog display will typically be in the direction of travel of the vehicle. If the driver looks sideways into an exterior mirror, the display shifts into a peripheral viewing area of the driver, where movements are perceived very strongly. As explained above, "jitter" or "wobble" movements of the display are often unavoidable in the current state of the art and would lead to distractions in the driver's peripheral vision. By moving the display into a second predetermined area of the field of view of the head-mounted display, the contact analogy or spatially fixed representation is abandoned. By the predetermination of the second area, this is fixed in advance and is not influenced by the position of the object in the environment or by the location of the fixed display. The task of contact analogy or fixed arrangement can be indicated by a (graphical) reference. The position of the display in the field of view of the head-mounted display can now be selected so that distracting movements of the display are avoided. It is an arrangement of the display, for example, left or right in the second area conceivable, depending on whether the detected object of the environment or the fixed location of the environment is located to the left or right of the second area. It is also conceivable to adapt the vertical position of the display in accordance with averaged over a period vertical position in which would be a contact analog display or stationary display. The second area may be located in the peripheral viewing area of the user and thus, depending on the dimensioning of the field of view of the display, in an edge area of the field of view of the display (the edge area need not touch the edge of the display). Alternatively, a stationary arrangement of the display in the second area is conceivable. In other words, the display is displayed stationary or independent of the viewing direction in the second area with respect to the field of view of the head-mounted display. The second area may be located in the peripheral viewing area of the user and thus, depending on the dimensioning of the field of view of the display, in an edge area of the field of view of the display (the edge area need not touch the edge of the display).

The term right or left refers to the orientation of the field of view when properly wearing the head-mounted display.

In a further development, the first and the second predetermined range do not overlap. Both areas are thus separated from each other and possibly also from each other, so that there is a distance between their nearest locations.

In a development, the first area is symmetrical to a vertical central axis of the field of view of the head-mounted display and this axis is at least partially included. A central axis is, in particular, a vertical axis and, in particular, the vertical axis of symmetry when the field of vision is symmetrical with respect to the vertical. It is assumed herein that the head-mounted display is oriented according to its intended use. Furthermore, the central axis can also denote, for example, a vertical axis through the center of gravity of the field of view.

In another development, the second area is arranged on the left or right of a vertical central axis of the field of view of the head-mounted display and does not touch the central axis of the field of view of the head-mounted display. As used herein, "touching" does not mean that the perimeter of one area does not intersect or overlap the central axis or circumference of another area. With this arrangement of the second area, the central view of the user can be kept clear and the view of, for example, instruments or in the exterior mirror can be made possible.

In a training, the second area does not touch the left or right edge of the field of view; and between the left and right edges of the field of view and the second area, a third area is arranged. The method of further development further comprises: displaying a display of a second category in the third area of the field of view of the head-up display; Wherein the display comprises in particular a monochrome filling of the third area with a signal color. It can thus be arranged on the left or right edge of the field of view of the head-mounted display, in particular a strip and further in particular a comparatively narrow strip, which then lights up in monochrome, if from this direction (left or right) threatens a danger. This type of display is suitable, for example, for warnings of a system that observes the blind spot of a vehicle and warns of collisions. Depending on the direction from which the collision threatens, the risk can be graphically displayed to the user in this same direction, for example by coloring the third area with the signal color red and possibly blinking. In other words, the user uses a means of locomotion, and the method further comprises: determining that the alert relates to a hazard on the left or right side of the vehicle, in particular a danger of collision; Wherein displaying the second category display is performed in response to determining that the alert relates to a hazard on the left and right sides of the vehicle, respectively.

A means of transportation may very generally be a vehicle, a motor vehicle, in particular a car or truck, an aircraft or a ship. In a development, the method comprises displaying a display of a third category in a fourth area of the field of view of the head-mounted display; Maintaining the display of the third category display in the fourth area of the field of view in response to detecting the predetermined line of sight. In this way, for example, warnings, which should always appear in the central field of vision of the driver, even when the driver's gaze away from the road in a central field of vision can be displayed and so quickly attract the attention of the driver.

In a further development, the display of the first category is a display that does not always have to be perceived by the driver of a motor vehicle, in particular navigation instructions, lane information, information about speed limits or the display of the currently driven speed.

In another development, the display of the third category is a display that is to be perceived by a driver of a motor vehicle during movements of the head, in particular warnings about possible collisions of the motor vehicle with other road users or objects.

It may additionally be provided that a rotation of the head of the driver is detected and the display is oriented so that it continues to stand upright for the user, in other words "right around." Thus, a rotation of the head around the viewing direction is compensated This may be advantageous, for example, when a driver of a motor vehicle turns his head as a user of the head-mounted display in order to be able to recognize a very close traffic light. The displays in the field of view are then rotated equally in order to continue to be upright in relation to the environment Disclosed is also a device comprising a head-mounted display, means for detecting the line of sight of a user and electronic calculating means, the device being arranged to carry out one of the methods disclosed above, means for detecting the viewing direction, sometimes called tracker, These are known in the art For example, a so-called head tracker, but also an eye tracker. The funds can be in the head-mounted display can be integrated or realized by a camera directed to the user and corresponding image processing or by a combination of these possibilities. Also conceivable is the use of detection means based on acoustic or electromagnetic phenomena, as known in the art.

BRIEF DESCRIPTION OF THE DRAWING

1a shows the schematic distribution of the field of view of a head-mounted display in a first configuration according to a first embodiment.

1 a shows the schematic division of the field of view of a head-mounted display in a second configuration according to the first embodiment.

Fig. 2 shows the schematic structure of a device for arranging displays in a user-carried head-mounted display according to another embodiment.

Like reference numerals refer to corresponding elements throughout the figures.

DETAILED DESCRIPTION OF THE EMBODIMENT

Fig. 1 shows the schematic distribution of the field of view 1 of a head-mounted display according to a first embodiment. The field of view 1 is divided into several areas. In the first area 2, stationary displays of a first category for the driver of a typical limousine car are displayed. By way of example, a recognized speed limit 8 is displayed in FIG. 1 a, here 50 km / h. The representation of the speed limit in area 2 is optimized for a driver's front view of the road. For the driver, the display 8 of the speed limit does not cover the road ahead, but only his view of the engine. The driver is continuously recorded via a camera, also known as a head tracker, in the front section of the vehicle. If it is detected by means of corresponding processing of the recordings of the camera that the driver is looking into the exterior mirror of his vehicle, the display 8 is displaced into the second area 3, as shown in FIG. 1b. Otherwise, the display 8 could partially obscure the driver's view of the exterior mirror and thus cause other road users adjacent to the vehicle to be overlooked. Alternatively, the display 8 could also be moved to the second area 4. It is envisaged to move the display 8 to the area 3 when the driver looks into the right side mirror and into the area 4 when looking into the left side mirror. In general, however, a reverse assignment is possible, ie a shift in the area 3, when the driver looks in the left side mirror and accordingly in the area 4 for the right side mirror.

The third areas 5 and 6 are used to display additional warnings with locally specific contextual reference in the driver's peripheral field of vision. An example of this is a collision warning on the right or left of the vehicle. If the vehicle is on a collision course with another road user and this danger exists on the left side of the vehicle, the area 5 is colored red, as shown in FIG. 1b (represented by hatching in FIG. 1b). The same is possible for the right area 6.

Warnings, which should always appear in the central field of vision of the driver, are displayed in the fourth area 7.

Fig. 2 shows the schematic structure of a device for arranging displays in a user-carried head-mounted display according to another embodiment. The display generation module 9 generates the representations to be displayed, that is to say, for example, the speed limit symbol 8 according to FIGS. 1 a and 1 b. The display management module 10 determines where and how the display is displayed, taking into account the detected viewing direction by the sight line detection module 12. First, the displays are assigned to specific areas. This assignment can be made according to whether the display should always be in the driver's central field of vision (Assignment to area 7 in FIG. 1 a), whether the display does not require immediate attention and can be shifted favorably in certain viewing directions into another area (assignment to area 2/3 in FIG. 1 a) or in the peripheral field of vision ( Assignment to area 5/6 in Fig. 1a). Depending on the occurrence of further conditions, for example the detection of the particular line of sight, or the detection of a hazard, the displays are then reassigned if necessary, in accordance with the method described with reference to FIGS. 1a and 1b and previously described. The modules 9 and 10 are designed as correspondingly programmed electronic computing units. The display management module 10 finally controls the head-mounted display 11.

Claims

A method of arranging displays in a head-mounted display carried by a user comprising: displaying a display (8) of a first category in a first predetermined area (2) of the field of view (1) of the head-mounted display;

Detecting a predetermined viewing direction of the user;

In response to the capture:

Terminating the display of the first-category display (8) in the first predetermined area (2) of the field of view (1) of the head-mounted display,

Displaying the display (8) of the first category in a second predetermined area (3, 4) of the field of view of the head-mounted display.

The method of claim 1, wherein the first (2) and second (3, 4) predetermined ranges do not overlap.

3. The method according to any one of the preceding claims, wherein the first region (2) is symmetrical to a vertical center axis of the field of view (1) of the head-mounted display and this axis comprises at least partially.

4. The method according to any one of the preceding claims, wherein the second region (3, 4) is arranged on the left or right of a vertical central axis of the field of view (1) of the head-mounted display and does not touch the central axis of the field of view (1) of the head-mounted display.

5. The method of claim 4, wherein the second region (3, 4) does not touch the left or right edge of the field of view (1); wherein between the left and right edge of the field of view (1) and the second region (3, 4), a third region (5, 6) is arranged.

The method further comprising: displaying a display of a second category in the third area (5, 6) of the field of view of the head-up display;

Wherein the display comprises in particular a monochrome filling of the third region (5, 6).

6. The method of claim 5, wherein the user uses a means of transportation;

The method further comprises:

Determining that the alert relates to a hazard on the left or right side of the vehicle, in particular a danger of collision; Where the display of the second category in response to the

Determining that the warning is at a hazard on the left is done or right side of the means of transport and takes into account whether the danger is on the left or right side of the means of locomotion.

A method according to any one of the preceding claims, further comprising:

Displaying a display of a third category in a fourth area (7) of the field of view (1) of the head-mounted display;

Maintaining the display of the third category display in the fourth area (7) of the field of view (1) in response to detecting the predetermined line of sight.

8. The method according to any one of the preceding claims, wherein the display (8) of the first category is a display that does not always or immediately must be perceived by the driver of a motor vehicle, in particular navigation instructions, lane advices, notices on speed limits or the display of the current speed traveled ,

9. The method according to any one of the preceding claims, wherein the display of the third category is a display that is to be perceived by a driver of a motor vehicle during movements of the head, in particular warnings on possible head-on collisions of the motor vehicle with other road users or objects.

10. An apparatus comprising a head-mounted display, means for detecting the viewing direction of a user and electronic computing means, the apparatus being adapted to carry out a method according to one of the preceding claims.