EP2580639A1 - A vehicle based display system and a method for operating the same - Google Patents

A vehicle based display system and a method for operating the same

Info

Publication number
EP2580639A1
EP2580639A1 EP10852979.3A EP10852979A EP2580639A1 EP 2580639 A1 EP2580639 A1 EP 2580639A1 EP 10852979 A EP10852979 A EP 10852979A EP 2580639 A1 EP2580639 A1 EP 2580639A1
Authority
EP
European Patent Office
Prior art keywords
display
driver
vehicle
information
movement
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP10852979.3A
Other languages
German (de)
French (fr)
Other versions
EP2580639A4 (en
Inventor
Fredrik SANDBLOM
Daniel RICKNÄS
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Volvo Truck Corp
Original Assignee
Volvo Lastvagnar AB
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Volvo Lastvagnar AB filed Critical Volvo Lastvagnar AB
Publication of EP2580639A1 publication Critical patent/EP2580639A1/en
Publication of EP2580639A4 publication Critical patent/EP2580639A4/en
Withdrawn legal-status Critical Current

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/113—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Arrangement of adaptations of instruments
    • B60K35/10—
    • B60K35/213—
    • B60K35/22—
    • B60K35/285—
    • B60K35/29—
    • B60K35/60—
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • B60K2360/149—
    • B60K2360/1526—
    • B60K2360/186—
    • B60K2360/1868—
    • B60K2360/195—
    • B60K2360/21—
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/10—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
    • B60R2300/101—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using cameras with adjustable capturing direction
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking

Definitions

  • the invention relates to a vehicle based display system and a method for operating the same according to the preambles of the independent claims.
  • Motor vehicles are usually equipped with a set of information display devices that include, in general, an analogue or digital instrument panel on which various quantities are displayed such as, for example, vehicle speed, engine speed, fuel level, etc., a number of optical indicators regarding the state of the vehicle indicating, for example, lights on, engine oil level, water coolant temperature, etc., and additional onboard display devices such as, for example, car radio, air-conditioner, navigator, etc.
  • Most of the analogue instruments comprise, for each quantity represented, a mechanical- type indicator needle representing the value of that quantity on an suitable graduated scale, generally consisting of a series of numeric characters of dimensions and style established during the instrument design phase, while the optical indicators generally comprise standard backlit graphical symbols, each indicating a respective state condition of the motor vehicle.
  • each quantity represented is composed of an LCD (Liquid Cristal Display) or a number of light emitting elements ("LED”) that can be selectively illuminated to form numeric characters indicating the value of that quantity in an associated unit of measurement, or sequentially illuminated to form a level indicator for that quantity on a graduated scale similar to that of an analogue instrument.
  • LCD Liquid Cristal Display
  • LED light emitting elements
  • Both types of instruments are usually able to display messages to the driver, for example warnings to indicate to an operator of the vehicle that a particular parameter reading, for example, the speedometer, tachometer, or temperature gage reading exceeds a desirable range.
  • a particular parameter reading for example, the speedometer, tachometer, or temperature gage reading exceeds a desirable range.
  • interactive warning systems that allow the operator of the vehicle to confirm that a message has been detected.
  • specific buttons for example on the steering wheel, can be used for navigation between different functions or different areas of the instrument cluster and for acknowledging messages.
  • speech recognition systems can be used for voice control of various functions in a vehicle and also for acknowledging messages.
  • a system adapted for use in a commercial vehicle should be more user friendly to avoid distraction and to minimize driver workload.
  • EP 1658191 describes a system for controlling a dual-view display in a vehicle in which the view of the driver is monitored and when the driver directs his/her line of view to the display, data relevant to the operation of the vehicle will be visible on the display and data otherwise only viewable by a passenger will be invisible.
  • a vehicle based display system which is characterized by a driver head tracking system with a sensor for monitoring the driver head position, a display for displaying information to a driver of the vehicle, and a control unit for controlling the display to modify displayed information depending on the driver head position.
  • a driver head tracking system for interaction with the display system enables the driver to interface with the display in a user friendly manner.
  • the display is connected to a camera which is provided with means for changing the camera image viewpoint.
  • a display for example, as a rear- view mirror.
  • the display viewpoint image can be modified when a side movement of the head in the transversal direction of the vehicle is detected.
  • the zoom distance of the display image can be modified when a movement of the head in the longitudinal direction of the vehicle is detected.
  • the head tracking system includes means for monitoring driver gaze direction.
  • An even more refined interactive system can be achieved by monitoring eye movement.
  • detection of gaze direction can be used for modification of displayed information, for example can certain information on a display be highlighted when an eye movement away from the display is detected.
  • an eye movement to a certain field of the display may confirm that a message displayed in said field has been viewed by the driver.
  • the display is adapted for displaying information related to vehicle status.
  • Fig. 1 is a schematic side view illustration of a display system according to one embodiment of the invention arranged inside a vehicle; and Fig. 2-4 shows in front view the display cluster of Fig. 1 in three different modes of use. Detailed description of the invention
  • a display system comprising a instrument cluster 10 installed in the dashboard 11 of a vehicle 12 having a windscreen 13.
  • the instrument cluster is connected to a control unit 14 which receives imaging input from a digital image sensor camera 15.
  • the instrument cluster 10 preferably comprises a digital graphics screen, for example an LCD or plasma screen.
  • the camera 15 is adapted to register the position of the driver's head or eye 16a, 16b.
  • the control unit 14 receives image data from the camera 15, analyzes the collected image information and adapts the video signal sent to the digital graphics screen.
  • the eye 16a illustrates a first normal position of the driver's head and a corresponding display view 17a on a virtual instrument cluster 18.
  • the camera 15 detects the head or eye position and a virtual view corresponding to the head position is graphically transmitted by the control unit 14 to the non- virtual instrument cluster 10.
  • Fig. 2 shows an instrument cluster view corresponding to the head position 16a.
  • the instrument cluster provides information regarding vehicle speed and engine speed at the centre of the cluster.
  • Information regarding engine temperature and fuel level is provided at the left side of the cluster.
  • Service information is provided at the right side of the cluster.
  • the eye 16b illustrates a movement of the driver's head towards the instrument cluster 10 in accordance with the arrow 19.
  • the display view 17b on the virtual instrument cluster 18 is moved correspondingly in accordance with the arrow 20.
  • the camera 15 detects the altered head or eye position and this new different virtual view is graphically transmitted by the control unit 14 to the nonvirtual instrument cluster 10.
  • the control unit 14 moves the viewpoint of the digital image downwards as illustrated by the arrow 20 allowing information to be added at the bottom of the cluster screen.
  • Fig. 3 shows the instrument cluster view corresponding to the head position 16b. In this view the information described above has been moved slightly upwards to allow additional information regarding radio station selection and vehicle navigation information to be displayed at the bottom of the instrument display, see arrow 21.
  • the illusion perceived by the driver looking at the display screen and moving the head in the direction of the arrow 19, is that he or she is able to look past the bottom edge into an opening with a larger display screen at the bottom.
  • the vehicle driver can use the display system according to the invention to control the amount of displayed information on the instrument cluster 10 by head movement.
  • the driver head tracking system is provided with means for detecting driver gaze direction, it is possible to add further functionality. For example, if the head tracking system detects that driver gaze direction is aimed at the road ahead, certain information on the instrument cluster can be highlighted. This is illustrated in Fig. 4, where information regarding vehicle speed, engine speed and an important service message (see arrow 22) regarding ABS system function are highlighted. Instead of highlighting information, a detailed image can be modified to be more suited for peripheral view.
  • a series of detected shifts of gaze direction by the driver towards the service message, within a certain time-frame can for example be used as a confirmation that the driver has realized the message.
  • the display system according to the invention can be utilized by the driver to control different functionalities.
  • an enhanced interactive driver environment can be obtained by using the invention.
  • Another possible application of the invention is in the field of mirrors.
  • a heavy commercial vehicle for example a trailer tractor, is usually equipped with a set of adjustable external mirrors allowing the driver to view traffic in neighbouring lanes at the sides and towards the rear of the vehicle.
  • Other mirrors may be arranged at the front and sides of the tractor cab to view the road immediately in front of the vehicle and near its front wheels. All these external mirrors need frequent cleaning to remove contamination.
  • the mirror installations reduce the aerodynamic efficiency of the vehicle.
  • each external mirror element is replaced by a corresponding display inside the cab.
  • An external camera is connected to the display via a control unit.
  • the external camera is controlled via the head tracking system so that the camera viewpoint is changed simulating natural physical viewpoint changes offered when moving the head relative to a conventional fixed mirror surface.
  • a detected side movement of the driver head in the transversal direction of the vehicle modifies the viewpoint angle of the camera and the displayed viewpoint on the display.
  • a detected movement of the driver head in the longitudinal direction of the vehicle modifies the zoom distance of the display image.
  • the head tracking system may also be used for controlling a camera view of the area behind the vehicle when travelling backwards.

Abstract

The invention relates to a vehicle based display system, comprising a driver head tracking system with a sensor (15) for monitoring the driver head position and/or gaze direction. The system also comprises a display (10) for displaying information to a driver of the vehicle, and a control unit (14) for controlling the display (10) to modify displayed information depending on the driver head position. The invention also relates to a method for operating the display system.

Description

A vehicle based display system and a method for operating the same
Background of the invention
The invention relates to a vehicle based display system and a method for operating the same according to the preambles of the independent claims.
Motor vehicles are usually equipped with a set of information display devices that include, in general, an analogue or digital instrument panel on which various quantities are displayed such as, for example, vehicle speed, engine speed, fuel level, etc., a number of optical indicators regarding the state of the vehicle indicating, for example, lights on, engine oil level, water coolant temperature, etc., and additional onboard display devices such as, for example, car radio, air-conditioner, navigator, etc. Most of the analogue instruments comprise, for each quantity represented, a mechanical- type indicator needle representing the value of that quantity on an suitable graduated scale, generally consisting of a series of numeric characters of dimensions and style established during the instrument design phase, while the optical indicators generally comprise standard backlit graphical symbols, each indicating a respective state condition of the motor vehicle.
Instead, most of the digital instruments form an instrument cluster where each quantity represented is composed of an LCD (Liquid Cristal Display) or a number of light emitting elements ("LED") that can be selectively illuminated to form numeric characters indicating the value of that quantity in an associated unit of measurement, or sequentially illuminated to form a level indicator for that quantity on a graduated scale similar to that of an analogue instrument.
Both types of instruments are usually able to display messages to the driver, for example warnings to indicate to an operator of the vehicle that a particular parameter reading, for example, the speedometer, tachometer, or temperature gage reading exceeds a desirable range. With so much information available to the operator of the vehicle, it is desirable to have interactive warning systems that allow the operator of the vehicle to confirm that a message has been detected. According to prior art, specific buttons, for example on the steering wheel, can be used for navigation between different functions or different areas of the instrument cluster and for acknowledging messages. Alternatively, speech recognition systems can be used for voice control of various functions in a vehicle and also for acknowledging messages.
However, these prior art interactive systems can be complicated to use. Preferably, a system adapted for use in a commercial vehicle should be more user friendly to avoid distraction and to minimize driver workload.
EP 1658191 describes a system for controlling a dual-view display in a vehicle in which the view of the driver is monitored and when the driver directs his/her line of view to the display, data relevant to the operation of the vehicle will be visible on the display and data otherwise only viewable by a passenger will be invisible.
Summary of the invention
It is an object of the invention to provide a vehicle based display system and a method for operating the same which enables the operator to interact with the display clusters of a vehicle without the problems described above.
This object is achieved by the features of the independent claims. The other claims and the description disclose advantageous embodiments of the invention.
According to the invention, a vehicle based display system is proposed which is characterized by a driver head tracking system with a sensor for monitoring the driver head position, a display for displaying information to a driver of the vehicle, and a control unit for controlling the display to modify displayed information depending on the driver head position. The use of a driver head tracking system for interaction with the display system enables the driver to interface with the display in a user friendly manner.
According to one embodiment of the invention, the display is connected to a camera which is provided with means for changing the camera image viewpoint. This enables the driver to use a display, for example, as a rear- view mirror. For example, the display viewpoint image can be modified when a side movement of the head in the transversal direction of the vehicle is detected. Also, the zoom distance of the display image can be modified when a movement of the head in the longitudinal direction of the vehicle is detected.
According to another embodiment of the invention, the head tracking system includes means for monitoring driver gaze direction. An even more refined interactive system can be achieved by monitoring eye movement. Thus, detection of gaze direction can be used for modification of displayed information, for example can certain information on a display be highlighted when an eye movement away from the display is detected.
Alternatively or additionally, an eye movement to a certain field of the display may confirm that a message displayed in said field has been viewed by the driver.
Preferably, the display is adapted for displaying information related to vehicle status.
Brief description of the drawings
Fig. 1 is a schematic side view illustration of a display system according to one embodiment of the invention arranged inside a vehicle; and Fig. 2-4 shows in front view the display cluster of Fig. 1 in three different modes of use. Detailed description of the invention
In the drawings, equal or similar elements are referred to by equal reference numerals. The drawings are merely schematic representations, not intended to portray specific parameters of the invention. Moreover, the drawings are intended to depict only typical embodiments of the invention and therefore should not be considered as limiting the scope of the invention.
For explaining the invention, an embodiment of a display system is depicted in Fig. 1, comprising a instrument cluster 10 installed in the dashboard 11 of a vehicle 12 having a windscreen 13. The instrument cluster is connected to a control unit 14 which receives imaging input from a digital image sensor camera 15. The instrument cluster 10 preferably comprises a digital graphics screen, for example an LCD or plasma screen. The camera 15 is adapted to register the position of the driver's head or eye 16a, 16b. The control unit 14 receives image data from the camera 15, analyzes the collected image information and adapts the video signal sent to the digital graphics screen. In Fig. 1, the eye 16a illustrates a first normal position of the driver's head and a corresponding display view 17a on a virtual instrument cluster 18. The camera 15 detects the head or eye position and a virtual view corresponding to the head position is graphically transmitted by the control unit 14 to the non- virtual instrument cluster 10. Fig. 2 shows an instrument cluster view corresponding to the head position 16a. In this view the instrument cluster provides information regarding vehicle speed and engine speed at the centre of the cluster. Information regarding engine temperature and fuel level is provided at the left side of the cluster. Service information is provided at the right side of the cluster.
In Fig. 1, the eye 16b illustrates a movement of the driver's head towards the instrument cluster 10 in accordance with the arrow 19. In this second position of the driver's head the display view 17b on the virtual instrument cluster 18 is moved correspondingly in accordance with the arrow 20. The camera 15 detects the altered head or eye position and this new different virtual view is graphically transmitted by the control unit 14 to the nonvirtual instrument cluster 10. Preferably, the control unit 14 moves the viewpoint of the digital image downwards as illustrated by the arrow 20 allowing information to be added at the bottom of the cluster screen. Fig. 3 shows the instrument cluster view corresponding to the head position 16b. In this view the information described above has been moved slightly upwards to allow additional information regarding radio station selection and vehicle navigation information to be displayed at the bottom of the instrument display, see arrow 21.
Thus, the illusion perceived by the driver looking at the display screen and moving the head in the direction of the arrow 19, is that he or she is able to look past the bottom edge into an opening with a larger display screen at the bottom. Hence, the vehicle driver can use the display system according to the invention to control the amount of displayed information on the instrument cluster 10 by head movement. If the driver head tracking system is provided with means for detecting driver gaze direction, it is possible to add further functionality. For example, if the head tracking system detects that driver gaze direction is aimed at the road ahead, certain information on the instrument cluster can be highlighted. This is illustrated in Fig. 4, where information regarding vehicle speed, engine speed and an important service message (see arrow 22) regarding ABS system function are highlighted. Instead of highlighting information, a detailed image can be modified to be more suited for peripheral view.
Additionally, a series of detected shifts of gaze direction by the driver towards the service message, within a certain time-frame, can for example be used as a confirmation that the driver has realized the message. Thus, the display system according to the invention can be utilized by the driver to control different functionalities. Hence, an enhanced interactive driver environment can be obtained by using the invention. Another possible application of the invention is in the field of mirrors. A heavy commercial vehicle, for example a trailer tractor, is usually equipped with a set of adjustable external mirrors allowing the driver to view traffic in neighbouring lanes at the sides and towards the rear of the vehicle. Other mirrors may be arranged at the front and sides of the tractor cab to view the road immediately in front of the vehicle and near its front wheels. All these external mirrors need frequent cleaning to remove contamination. The mirror installations reduce the aerodynamic efficiency of the vehicle.
According to the invention, each external mirror element is replaced by a corresponding display inside the cab. An external camera is connected to the display via a control unit. The external camera is controlled via the head tracking system so that the camera viewpoint is changed simulating natural physical viewpoint changes offered when moving the head relative to a conventional fixed mirror surface. Preferably, a detected side movement of the driver head in the transversal direction of the vehicle modifies the viewpoint angle of the camera and the displayed viewpoint on the display. In the same manner can a detected movement of the driver head in the longitudinal direction of the vehicle modifies the zoom distance of the display image. The head tracking system may also be used for controlling a camera view of the area behind the vehicle when travelling backwards. The arrangement and method according to the invention reduces driver workload and increases traffic safety. The invention is not to be regarded as being limited to the embodiments described above, a number of additional variants and modifications being possible within the framework of the following patent claims. The system and the method can, for example, also be used for conferring messages displayed by other means than a digital display screen.

Claims

C L A I M S
1. A vehicle based display system, characterized by
a driver head tracking system with a sensor (15) for monitoring the driver head position,
a display (10) for displaying information to a driver of the vehicle, and a control unit (14) for controlling the display (10) to modify displayed information depending on the driver head position.
The display system according to claim 1, wherein the display (10) is connected to vehicle exterior view camera provided with means for changing the camera image viewpoint.
The display system according to claim 1, wherein the head tracking system includes means for monitoring driver gaze direction.
4. The display system according to claim 3, wherein the control unit (14) for
controlling the display (10) is adapted to modify the displayed information when a certain eye movement is detected.
5. The display system according to claim 4, wherein the control unit (14) is adapted to regard an eye movement to a certain field of the display (10) as a confirmation that information in said field has been viewed by the driver.
6. A method for operating a vehicle based display system (10) according to one of the preceding claims, characterized by
detecting a movement of the vehicle driver head position or gaze direction, and
controlling a display for displaying information to a driver of the vehicle to modify the displayed information when a certain head movement is detected.
7. The method according to claim 6, wherein the display (10) is adapted for displaying information related to vehicle status.
8. The method according to claim 7, wherein a detected forward movement of the driver head in the longitudinal direction of the vehicle adds information to the display.
9. The method according to claim 8, wherein the information is added at the bottom field of the display (10).
10. The method according to claim 6, wherein the display is adapted for displaying a vehicle exterior view image.
11. The method according to claim 10, wherein a detected side movement of the driver head in the transversal direction of the vehicle modifies the viewpoint angle of the camera and the displayed viewpoint on the display .
12. The method according to claim 10 or 11 , wherein a detected movement of the driver head in the longitudinal direction of the vehicle modifies the zoom distance of the display image.
13. The method according to claim 6, further characterized by monitoring driver eye (16a, 16b) movement and modifying the displayed information when a certain eye movement is detected.
14. The method according to claim 13 , wherein information on the display ( 10) is highlighted when an eye movement away from the display is detected.
15. The method according to claims 13 or 14, wherein an eye movement to a certain field of the display (10) confirms that a message displayed in said field has been viewed by the driver.
EP20100852979 2010-06-10 2010-06-10 A vehicle based display system and a method for operating the same Withdrawn EP2580639A4 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/SE2010/000164 WO2011155878A1 (en) 2010-06-10 2010-06-10 A vehicle based display system and a method for operating the same

Publications (2)

Publication Number Publication Date
EP2580639A1 true EP2580639A1 (en) 2013-04-17
EP2580639A4 EP2580639A4 (en) 2014-06-11

Family

ID=45098292

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20100852979 Withdrawn EP2580639A4 (en) 2010-06-10 2010-06-10 A vehicle based display system and a method for operating the same

Country Status (4)

Country Link
EP (1) EP2580639A4 (en)
CN (1) CN103124943A (en)
BR (1) BR112012031410A2 (en)
WO (1) WO2011155878A1 (en)

Families Citing this family (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013101044A1 (en) * 2011-12-29 2013-07-04 Intel Corporation Systems, methods, and apparatus for controlling devices based on a detected gaze
GB2508860A (en) * 2012-12-13 2014-06-18 Nissan Motor Mfg Uk Ltd Vehicle Rear-View Camera System
US20140191965A1 (en) * 2013-01-08 2014-07-10 Qnx Software Systems Limited Remote point of view
EP2752730B1 (en) 2013-01-08 2019-04-03 Volvo Car Corporation Vehicle display arrangement and vehicle comprising a vehicle display arrangement
DE102013001327B4 (en) 2013-01-26 2017-12-14 Audi Ag Method and display system for viewing direction-dependent scaling of a representation
JP6364702B2 (en) * 2013-03-29 2018-08-01 アイシン精機株式会社 Image display control device, image display system, and display unit
EP3010761B1 (en) 2013-06-21 2019-07-24 Magna Electronics Inc. Vehicle vision system
JP2015121623A (en) * 2013-12-20 2015-07-02 カシオ計算機株式会社 Electronic equipment, display control method, and program
US10525883B2 (en) 2014-06-13 2020-01-07 Magna Electronics Inc. Vehicle vision system with panoramic view
US11472338B2 (en) 2014-09-15 2022-10-18 Magna Electronics Inc. Method for displaying reduced distortion video images via a vehicular vision system
US10127463B2 (en) 2014-11-21 2018-11-13 Magna Electronics Inc. Vehicle vision system with multiple cameras
US9783204B2 (en) 2015-02-02 2017-10-10 International Business Machines Corporation Cognitive displays
DE102015203675A1 (en) * 2015-03-02 2016-09-08 Bayerische Motoren Werke Aktiengesellschaft User interface and method for selecting a display element on a user interface
GB2536882B (en) * 2015-03-26 2021-12-22 Denso Corp Head up display adjustment
CN104802709A (en) * 2015-03-31 2015-07-29 山东理工大学 Intelligent rearview mirror system
US20160297362A1 (en) * 2015-04-09 2016-10-13 Ford Global Technologies, Llc Vehicle exterior side-camera systems and methods
KR102309316B1 (en) * 2015-06-02 2021-10-05 엘지전자 주식회사 Display apparatus for vhhicle and vehicle including the same
JP6493361B2 (en) * 2016-04-01 2019-04-03 株式会社デンソー Vehicle device, vehicle program, filter design program
US10909721B2 (en) 2016-06-29 2021-02-02 Seeing Machines Limited Systems and methods for identifying pose of cameras in a scene
DE102016224246A1 (en) * 2016-12-06 2018-06-07 Volkswagen Aktiengesellschaft Method and apparatus for interacting with a graphical user interface
US10082869B2 (en) * 2017-02-03 2018-09-25 Qualcomm Incorporated Maintaining occupant awareness in vehicles
EP3466762A1 (en) * 2017-10-05 2019-04-10 Ningbo Geely Automobile Research & Development Co. Ltd. A monitoring system and method for displaying one or more image views to a user of a vehicle
CN110297325B (en) * 2018-03-22 2023-01-13 蔚来控股有限公司 Augmented reality glasses and system and method for displaying information on vehicle by augmented reality glasses
CN110126740A (en) * 2019-05-29 2019-08-16 辽宁科大物联科技有限公司 A kind of control method and device of automotive electronics rearview mirror
CN110271419A (en) * 2019-06-28 2019-09-24 马瑞利汽车电子(广州)有限公司 A kind of automobile instrument vision-control device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1999056274A1 (en) * 1998-04-28 1999-11-04 Deluca Michael J Vision pointer method and apparatus
US20020085043A1 (en) * 2000-12-28 2002-07-04 International Business Machines Corporation Context-responsive in-vehicle display system
US20070057781A1 (en) * 1999-12-15 2007-03-15 Automotive Technologies International, Inc. Vehicular Heads-Up Display System
EP1997667A1 (en) * 2007-05-31 2008-12-03 Volkswagen AG Device and method for showing information

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5367315A (en) * 1990-11-15 1994-11-22 Eyetech Corporation Method and apparatus for controlling cursor movement
US5689619A (en) * 1996-08-09 1997-11-18 The United States Of America As Represented By The Secretary Of The Army Eyetracker control of heads-up displays
US6009210A (en) * 1997-03-05 1999-12-28 Digital Equipment Corporation Hands-free interface to a virtual reality environment using head tracking
US6396461B1 (en) * 1998-08-05 2002-05-28 Microvision, Inc. Personal display with vision tracking
DE19953835C1 (en) * 1999-10-30 2001-05-23 Hertz Inst Heinrich Computer-aided method for contactless, video-based gaze direction determination of a user's eye for eye-guided human-computer interaction and device for carrying out the method
DE10339314B3 (en) * 2003-08-27 2005-04-21 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Method for display control of different information in a vehicle and opto-acoustic information unit
JP4849333B2 (en) * 2006-12-04 2012-01-11 株式会社デンソー Visual aids for vehicles

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1999056274A1 (en) * 1998-04-28 1999-11-04 Deluca Michael J Vision pointer method and apparatus
US20070057781A1 (en) * 1999-12-15 2007-03-15 Automotive Technologies International, Inc. Vehicular Heads-Up Display System
US20020085043A1 (en) * 2000-12-28 2002-07-04 International Business Machines Corporation Context-responsive in-vehicle display system
EP1997667A1 (en) * 2007-05-31 2008-12-03 Volkswagen AG Device and method for showing information

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of WO2011155878A1 *

Also Published As

Publication number Publication date
BR112012031410A2 (en) 2016-11-08
WO2011155878A8 (en) 2013-01-03
EP2580639A4 (en) 2014-06-11
CN103124943A (en) 2013-05-29
WO2011155878A1 (en) 2011-12-15

Similar Documents

Publication Publication Date Title
WO2011155878A1 (en) A vehicle based display system and a method for operating the same
US10019965B2 (en) Vehicle display system having a plurality of color temperature settings
JP5232922B2 (en) Vehicle display device
EP2714456B1 (en) System and method for selectively altering content of a vehicle interface
US8390440B2 (en) Method for displaying a visual warning signal
KR102067667B1 (en) Navigation system and method for navigation
US20170136878A1 (en) Method for operating a motor vehicle in different driving modes, and motor vehicle
KR102000929B1 (en) Mirror replacement system for a vehicle
KR20190110482A (en) Method for calculating a fade-in of additional information for displaying on a display unit, apparatus for performing the method and motor vehicle and computer program
CN111837067A (en) Method for displaying a trajectory ahead of a vehicle or an object by means of a display unit, and device for carrying out the method
JP2008030729A (en) Vehicular display device
CN113924225A (en) Method for correcting a driving direction by means of a driver assistance system in a motor vehicle and control device therefor
JP2018197691A (en) Information processing device
JP7058800B2 (en) Display control device, display control method, and display control program
KR20120020745A (en) Display layout method for cluster of vehicle
JP2009006950A (en) Display device for movable body
JP5073703B2 (en) Vehicle display device
US11639181B2 (en) Lead vehicle braking warning system
WO2021132306A1 (en) Display control device, display device, display control method, and program
CN115158343A (en) Dynamic AR prompting
CN116963926A (en) Improved visual display using augmented reality heads-up display
JP2023047175A (en) Display control device for vehicle, display device for vehicle, vehicle, display control method for vehicle, and display control program for vehicle
KR102640693B1 (en) Integrated control system for cluster and hud of vehicles
US11491923B2 (en) Image presentation for vehicles with multiple cameras
US20240017613A1 (en) Display device for a vehicle

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20130110

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20140513

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 3/00 20060101ALI20140507BHEP

Ipc: G06F 3/01 20060101AFI20140507BHEP

Ipc: A61B 5/11 20060101ALN20140507BHEP

Ipc: A61B 3/113 20060101ALI20140507BHEP

Ipc: B60K 37/04 20060101ALI20140507BHEP

Ipc: G02B 27/00 20060101ALI20140507BHEP

Ipc: B60R 1/00 20060101ALI20140507BHEP

17Q First examination report despatched

Effective date: 20150521

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20151001