WO2014170279A1

WO2014170279A1 - Method for selecting an information source from a plurality of information sources for display on a display of data spectacles

Info

Publication number: WO2014170279A1
Application number: PCT/EP2014/057541
Authority: WO
Inventors: Martin Enders; Felix Klanner; Wolfgang Spiessl
Original assignee: Bayerische Motoren Werke Aktiengesellschaft
Priority date: 2013-04-19
Filing date: 2014-04-14
Publication date: 2014-10-23
Also published as: US9823735B2; DE102013207063A1; US20160041612A1; EP2987057A1; EP2987057B1

Abstract

A method for determining an information source from a plurality of information sources for display on data spectacles is disclosed, comprising: determining the spatial orientation of the data spectacles; determining one criterion from a plurality of criteria, each relating to the spatial orientation of the data spectacles, which is fulfilled by the determined spatial orientation of the data spectacles; wherein an information source is assigned to each criterion; selecting the information source assigned to the determined criterion.

Description

A method of selecting an information source from a plurality of information sources for display on a display of data glasses

The invention relates to methods for selecting an information source from a plurality of information sources for display on a display of data glasses, a corresponding device and a corresponding computer program.

Nowadays, data brains, sometimes called head-mounted displays, are known which comprise a display. A data brifle is worn on the head by a user similar to ordinary glasses used as a visual aid. The display of the data pad is located in the field of vision of the wearer. Some data glasses include a single-eye display, while others contain two partial displays, with each eye being associated with a partial display.

Furthermore, it is known that data glasses can comprise a semi-transparent display. Such an indication allows the wearer to recognize both displayed information and the environment behind the display. This type of display is particularly well suited for contact-analog presentation of information. In the contact-analog representation, the information to be displayed is assigned a location in the environment of the wearer and the information is displayed assigned to this location, sometimes also referred to as a location-correct display. This can be done by an overlaying of the information about the assigned location, which is apparent to the wearer, or a representation of the information in spatial proximity to the assigned location, possibly with a symbol such as a line, in order to interpret the assigned location. The information itself may also be a symbol, an image, text or the like. The contact-analogous representation is sometimes called augmented reality. It has become known Datenbrilien whose display is not in the central field of view of the wearer. The field of view and the central field of view are defined by the angular range in which people can typically perceive objects in their environment. The angle range is determined from the central viewing direction when looking straight ahead (the central position of the pupils with respect to the eye sockets). The central field of view lies within an angle rich of 10 °, 15 °, 20 ° or 25 ° from the central viewing direction when looking straight ahead. Thus, objects of the environment are only in the central field of view if they are within a kege-shaped space of the environment around the central line of sight when looking straight ahead. The field of view that is not in the central field of vision is called a peripheral field of view,

Data messages whose display is not in the central field of view of the wearer are less suitable for presenting information in a contact-analog way than data glasses with a display in the central visual field. This is because the attention and perception of a person's environment during an activity tends to focus on the central field of vision. Data glasses whose displays are not in the central field of vision of the wearer, however, are particularly suitable for providing abstract additional information to the wearer of the spectacles, such as the time of day or the date.

The object underlying the invention is to improve the display of information by Datenbriilen, especially for data glasses whose display is not in the central field of view of the wearer.

This object is solved by the subject matters of the independent claims. Advantageous developments are defined in the dependent claims.

In one aspect, a method for determining an information source from a plurality of information sources for display on a data goggle comprises: determining the spatial alignment of the data files; Determining a criterion from a plurality of criteria that is met by the particular spatial orientation of the data glasses, the criteria being respectively related to the spatial orientation of the data pad; each criterion being assigned an information source; Select the information source associated with the particular criterion.

In this way, it is possible for the wearer of the data glasses to be presented with different information, depending on which orientation the data glasses are located. Different information sources provide different information, in particular different types of information, for example abstract variables such as the speed of a vehicle or the video image of a camera. It often happens that different orientations of a person's head are associated with different activities. For example, at a typical office workstation, an alignment of the head to display a personal computer will be related to the person's work tasks. If the person is approached by a colleague, the orientation of the head will change in the direction of the colleague, who in the vast majority of cases will not be in the direction of viewing the PC. If this person wears data glasses, the spatial orientation of the data glasses will change according to the head movement of the person. This is used to select sources of information relevant to the respective activity and to display the person on the data glasses. For example, when viewing the PC, the time may be displayed. If the person turns their head away from the display, an e-mail input on the PC or a pending appointment can display a message in the data glasses that otherwise appears on the display of the PC and could be overlooked. In this way, the wearer of the spectacles is always provided with relevant information by selecting the information source.

Another area of use for the method according to the invention is when driving a vehicle. Again, different orientations of the head are often associated with different activities. When looking at the environment of the vehicle, in particular the surrounding environment, the head is often in a nearly horizontal orientation. On the other hand, the driver operates a function of the driver

Vehicle, such as a radio or air conditioning in the dashboard, the driver's head is often tilted down. For the different orientations of the head, which are related to the different activities of the driver, then information can be selected, which support the activity of the driver. For example, when the driver views the environment and keeps the head in a nearly horizontal orientation, the time or distance still to be traveled may be displayed up to a route destination. Tilts the driver his head down to controls the vehicle, the video recording of a front camera can be represented by the display of data glasses. In this way, the driver of his task, the environment to pay attention even at least partially, even if his gaze is directed into the interior of the vehicle.

Alternatively or additionally, when the driver looks into the interior, it is possible to output warnings from driver assistance systems that have recognized the danger of a collision to the display of the data glasses.

The proposed method is particularly advantageous if the wearer of the data glasses uses them according to the typical, assumed or intended carrying position. The plurality of information sources and the plurality of criteria may consist of two, three or more elements. One of the criteria of the plurality of criteria may be a fall-in criterion that is met whenever no other of the criteria of the plurality of criteria is met.

When determining the spatial orientation, it is not necessary to determine the complete spatial orientation in all three space dimensions, it may also be sufficient, for example, to determine the inclination of the data glasses to a horizontal. In a further development, one of the criteria from the majority of the criteria defines that the orientation of the data glasses is such that the wearer of the spectacles considers the surroundings of the vehicle, assuming that the data glasses are properly worn and stay in a vehicle. Alternatively or additionally, a criterion may define that the orientation of the spectacles is such that the wearer of the spectacles assumes other road users recognized by a driver assistance system, with the risk of a collision, on the assumption of data glasses worn in accordance with the intended purpose and staying in a vehicle consists. In another development, a criterion from the plurality of criteria indicates a direction range; wherein the data glasses are associated with a direction; the method further comprising: determining the direction associated with the data smile based on the determined spatial orientation of the data glasses. A directional area is a range of directions that can be defined, for example, by specifying angular ranges from the head of the wearer. The directional ranges may be defined according to the geometry between windows of the vehicle and the position of the wearer's head. A directional range can also be specified by a driver assistance system that has recognized the risk of a collision with another road user or objects and, to avoid the collision, has determined a directional range in which the driver should turn his back to recognize the danger. A directional range may also be just a determination of an area for the horizontal or vertical component of the associated direction. The directional range can take into account the settings of the seat of the wearer of the data glasses, since this changes the position of the head and thus also the directional range, which represents a view of the environment.

In another development, the data goggles comprise a camera, and determining the spatial orientation comprises: receiving a recording of the camera; Recognizing the image of a part of the interior of the vehicle in the receptacle; Determining the position of the image in the photograph; Determining the spatial orientation of the data glasses based on the specific position of the image in the recording. In this development, the alignment of the data pad is thus obtained by the evaluation of a camera recording. Especially in known environments such as in an interior of a vehicle, this development is advantageous. This is because the interior view of the vehicle is well known except for small changes caused by objects placed in the vehicle. This knowledge can be used to advantage in order to easily and accurately determine the alignment of the data goggles by means of processing the images of the camera. Such processing methods are known in the art. Recognizing the image of a part of the interior of the vehicle in the receptacle may include: detecting structures in the receptacle; Compare the detected structures in the receptacle with stored structures of the interior of the vehicle. A structure can be formed in particular by the transition to windows, or by operating elements.

In a further variant, the data glasses may alternatively or additionally comprise position sensors which are set up to detect the spatial position of the data glasses, the spatial orientation of the data glasses within a vehicle is then determined by means of the position sensors. In a preferred embodiment, the plurality of information sources comprises: a video camera, which is directed in the direction of travel of the vehicle or in any other direction, for example, laterally of the vehicle or up to view the sky, and an information processing, which is designed to abstract Output information, in particular physical measurements of the state of the vehicle, in particular the speed of the vehicle, the rotational speed of a drive of the vehicle, the power output of the drive of the vehicle or the filling state of the energy storage of the vehicle. It can be provided that a plurality of video cameras are provided, between which the driver or user can switch over, for example by means of a control surface on the data glasses.

In one embodiment, the display of the data glasses provides a representation only for an eye of the wearer of the data glasses. The display of the data glasses can cover less than a third or a quarter of the field of vision of the eye and not cover the central field of view. In another aspect, an apparatus comprises: means for determining the spatial orientation of the device; Electronic processing means; Wherein the apparatus is arranged to execute one of the above methods. The electronic processing means may be a computer, dedicated circuits or a microcontroller. The means for determining the spatial orientation of the device may be position sensors, or a camera in the Smart glasses and the electronic processing means programmatically adapted to determine the spatial orientation. This determination of the spatial orientation may be based on the known structure of the interior of the vehicle, as described above. The device may include interfaces to the information sources from the plurality of information sources. These interfaces may be wired or wireless and may include appropriate protocols for data exchange. Such interfaces and protocols are known in the art.

In another aspect, a computer program includes instructions for performing one of the above methods. The computer program may cause a computer to execute the method as it executes the instructions.

BRIEF DESCRIPTION OF THE DRAWINGS

Fig. 1 shows schematically a data glasses with semi-transparent display in a peripheral field of view according to an embodiment.

Fig. 2a shows schematically the data glasses in a first orientation according to the Ausführungsbeispiei.

Fig. 2b shows schematically the data glasses in a second orientation according to the Ausführungsbeispiei. Like reference numerals refer to corresponding elements throughout the figures.

DETAILED DESCRIPTION OF THE EMBODIMENT

Fig. 1 shows schematically a data glasses 1 with semi-transparent display 2 in a peripheral field of view according to a Ausführungsbeispiei. The Datenbrilie 1 further comprises two brackets 3 and a camera 4, which is mounted on one of the bracket. The Recording direction of the camera corresponds to a designated wearing the Datenbrilie 1 of the central viewing direction of the wearer. The camera 4 may additionally comprise electronic signal processing means for image processing. The bracket 3 of the Datenbrilie 1 are in the proper wearing on the ears 5 of the carrier, as shown in Fig. 2a.

FIG. 2a schematically shows a data pad 1 in a first orientation and FIG. 2b schematically shows the data glasses 1 in a second orientation. The posture of the wearer's head in FIG. 2a corresponds to the posture of a driver's head when driving a vehicle when the driver is looking at the surroundings of the vehicle. Fig. 2b shows the attitude of the driver's head when operating controls in the dashboard of the vehicle. The head is tilted downwards. In operation, the camera 4 takes pictures regularly. These are processed in an electronic image processing (not shown). An attempt is made in the recording to recognize known and pre-stored structures of the dashboard and the boundaries of the windows. When structures of the dashboard and the boundaries of the windows are detected, their position in the receptacle is determined. From the position of the recognized structures and boundaries, the orientation of the data pad 1 can be deduced. This alignment is now compared to two criteria. According to the first criterion, it is checked whether the positions of recognized structures or window boundaries are within a position range, for example in the lower third! the recording. This suggests that the driver's head is held relatively horizontal, allowing the driver to view the environment. The second criterion is a collection criterion that is always met when the first criterion is not met, it defines that the positions of the recognized structures and window boundaries are in the upper two thirds of the image (ie the negation of all other criteria). If the second criterion is met, this suggests that the driver has tilted his head to look at the dashboard. Each criterion is assigned an information source. In the present case, the fulfillment of the first criterion causes the display of the speed of the vehicle and the time that an on-board computer provides. In fulfilling the second criterion, the display of the video image of a front camera of the vehicle is anlasst. In this Wesse the driver, even if he looks at the dashboard, at least partially observe the traffic ahead.

Claims

A method of determining an information source from a plurality of information sources for display on data glasses, comprising:

Determining the spatial orientation of the data glasses;

Determining a criterion from a plurality of criteria, each related to the spatial orientation of the data glasses, that is satisfied by the particular spatial orientation of the data glasses; wherein each criterion is assigned an information source;

Select the information source associated with the particular criterion.

The method of claim 1, wherein one of the criteria of the plurality of criteria defines that the orientation of the data glasses is such that the wearer of the glasses, assuming a properly worn smart phone and staying in a vehicle, views the environment of the vehicle.

The method of any one of the preceding claims, wherein a criterion from the plurality of criteria indicates a direction range; wherein the data glasses are associated with a direction; the method further comprising:

Determining the direction associated with the data glasses based on the particular spatial orientation of the data glasses. The method of any one of the preceding claims, wherein the data glasses comprise a camera, and wherein determining the spatial orientation comprises:

Receiving a picture of the camera;

Recognizing the image of a part of the interior of a vehicle in the receptacle;

Determining the position of the image or a portion of the image in the image;

Determining the spatial orientation of the data glasses based on the specific position of the image or the part of the image in the recording.

The method of claim 4, wherein detecting the image of a portion of the interior of the vehicle in the receptacle comprises:

Recognition of structures in the recording;

Compare the detected structures in the receptacle with stored structures of the interior of the vehicle.

Method according to one of the preceding claims, wherein the data glasses comprise position sensors which are adapted to detect the spatial position of the data glasses, wherein the determination of the spatial orientation of the data glasses by means of the position sensors. Method according to one of the preceding claims, wherein the plurality of information sources comprises: a video camera, which is directed in the direction of travel of the vehicle or to the side or upwards, and an information processing, which is adapted to output physical measurements of the state of the vehicle, in particular the Speed of the vehicle, the speed of a drive of the vehicle, the power output of the drive of the vehicle or the filling state of the energy storage of the vehicle.

Method according to one of the preceding claims, wherein the data glasses provide an indication only for an eye of the wearer of the data glasses, and wherein in particular the display of the data glasses covers less than a third or a quarter of the field of view of the eye and does not cover the central viewing area.

Apparatus comprising:

Means for determining the spatial orientation of the device; Electronic processing means;

Wherein the apparatus is adapted to carry out one of the methods according to any one of the preceding claims.

A computer program comprising instructions for carrying out a method according to any one of claims 1 to 8.