US20020105439A1 - Vehicle information acquisition and display assembly - Google Patents
Vehicle information acquisition and display assembly Download PDFInfo
- Publication number
- US20020105439A1 US20020105439A1 US09/370,144 US37014499A US2002105439A1 US 20020105439 A1 US20020105439 A1 US 20020105439A1 US 37014499 A US37014499 A US 37014499A US 2002105439 A1 US2002105439 A1 US 2002105439A1
- Authority
- US
- United States
- Prior art keywords
- vehicle
- assembly
- certain
- interest
- region
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 claims description 14
- 230000001419 dependent effect Effects 0.000 claims 1
- 238000004891 communication Methods 0.000 description 9
- 238000012545 processing Methods 0.000 description 7
- 230000000712 assembly Effects 0.000 description 5
- 238000000429 assembly Methods 0.000 description 5
- 230000007423 decrease Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 5
- 230000007613 environmental effect Effects 0.000 description 5
- 230000008859 change Effects 0.000 description 4
- 230000000717 retained effect Effects 0.000 description 4
- 238000002604 ultrasonography Methods 0.000 description 3
- 241001465754 Metazoa Species 0.000 description 2
- 230000004888 barrier function Effects 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 239000011435 rock Substances 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 230000004397 blinking Effects 0.000 description 1
- 230000001149 cognitive effect Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 238000003909 pattern recognition Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
- G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/10—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
- B60R2300/101—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using cameras with adjustable capturing direction
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/10—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
- B60R2300/105—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using multiple cameras
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/10—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
- B60R2300/106—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using night vision cameras
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/20—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used
- B60R2300/205—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used using a head-up display
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
- B60R2300/304—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing using merged images, e.g. merging camera image with stored images
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/40—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the details of the power supply or the coupling to vehicle components
- B60R2300/404—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the details of the power supply or the coupling to vehicle components triggering from stand-by mode to operation mode
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/60—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by monitoring and displaying vehicle exterior scenes from a transformed perspective
- B60R2300/607—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by monitoring and displaying vehicle exterior scenes from a transformed perspective from a bird's eye viewpoint
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/70—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by an event-triggered choice to display a specific image among a selection of captured images
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
- B60R2300/8053—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for bad weather conditions or night vision
Definitions
- This invention relates to a vehicle information acquisition and display assembly and more particularly to an assembly for use within a vehicle, which is adapted to selectively and automatically create and/or define a “region of interest”, and which is further adapted to selectively acquire and display information relating to and/or representing certain objects located within the created and/or defined “region of interest”.
- Another prior method or technique of increasing the driver's awareness or knowledge of the area proximate to the vehicle (or of the vehicle's environment) requires the installation of a number of sensors upon and/or within the vehicle. Particularly, these selectively installed sensors provide certain information to the driver and warn the driver if the vehicle is close to contacting an object (e.g., if the vehicle is about to “back into” the object)
- the relatively large number of sensors used in certain vehicles often and undesirably “bombards” and/or confuses the driver with an overabundance of substantially “real-time” information, including much information that has little or no relevance or importance to the driver (e.g., images of stationary objects which are remotely located from the vehicle).
- This driver “information overload” decreases the ability of the driver to discern information which is truly useful to the driver or which describes potential or imminent hazards; the truly relevant or important information being “lost” or obscured by all of the other data or information which is substantially and simultaneously presented to the driver.
- This driver “information overload” also increases the probability of a collision due to the great amount of time needed by the driver to decipher or review all of the provided information, thereby substantially preventing or hindering the driver from attending to and/or concentrating “on the road” and on the task of safely maneuvering the vehicle.
- a vehicle information system which acquires and provides sufficient information related to the vehicle's environment to adequately assist the driver to avoid a collision without “overloading” the driver with extraneous, non-relevant and/or “non-helpful” types of information.
- a vehicle information system which selectively creates a dynamically configurable monitored area which provides relevant information to the driver concerning and/or representing objects residing within this dynamically configurable area.
- a vehicle display assembly for use within a vehicle.
- the vehicle is selectively driven in proximity to at least one object.
- the display assembly includes at least one sensor which senses the at least one object and which provides an output signal having a certain value; and a processor which is coupled to the at least one sensor, which contains at least one object criteria value, which receives the output signal, and which compares the certain value of the output signal to the at least one object criteria value and, based upon the comparison, which selectively generates and displays at least one icon representing the at least one object.
- a method of displaying information related to an object located in proximity to a vehicle is provided.
- the vehicle is selectively travelling at a certain speed and at a certain direction.
- the method includes the steps of providing at least one sensor which measures the speed and direction of the vehicle; providing a controller for selectively creating a “region of interest” around the vehicle based upon the measured speed and the direction of the vehicle; providing at least one sensor for measuring the location of the object and for measuring the size of the object; determining whether the object resides within the “region of interest”; providing an icon; and displaying the icon only if the object resides within the “region of interest”.
- FIG. 1 is a block diagram of a vehicle information assembly which is selectively deployed within a conventional vehicle and which is made in accordance with the teachings of the preferred embodiment of the invention
- FIG. 2 is a top view of the vehicle which is shown in FIG. 1;
- FIG. 3 is a block diagram illustrating certain broad functional aspects of the vehicle information assembly which is shown in FIG. 1;
- FIG. 4 is a block diagram illustrating certain detailed functional aspects of the vehicle information assembly which is shown in FIG. 1;
- FIG. 5 illustrates one example of a user interface or a display screen which is used by the vehicle information assembly which is shown in FIG. 1 and further illustrating the selective display of data in a “top view” type of informational display format;
- FIG. 6 illustrates a second example of a user interface or a screen which is used by the vehicle information assembly which is shown in FIG. 1 and further illustrating the selective display of data in a “perspective view format” type of informational display format;
- FIG. 7 illustrates a third example of a user interface or a screen which is used by the vehicle information assembly shown in FIG. 1 and further illustrating the selective display of data in an “isometric view” type of informational display format;
- FIG. 8 illustrates a fourth example of a user interface or a screen which is used by the vehicle information assembly shown in FIG. 1 and further illustrating the selective display of data in a “top view” type of informational display format;
- FIG. 9 illustrates a fifth example of a user interface or a screen which is used by the vehicle information assembly shown in FIG. 1 and further illustrating the selective display of data in a “perspective view” type of informational display format;
- FIG. 10 illustrates a sixth example of a user interface or a screen which is used by the vehicle information assembly shown in FIG. 1 and further illustrating the selective display of data in an “isometric view” type of informational display format.
- system or assembly 10 includes a conventional and commercially available microprocessor, microcontroller or controller 12 having a memory portion 14 and operating under stored program control. More particularly, controller 12 is electrically, physically, and communicatively coupled to “vehicle attribute” sensors 16 , “surrounding area” or “environmental” data/information acquisition sensors 18 , a receiver 24 , and a user input device 28 , by use of at least one communications bus or path 26 . Controller 12 is electrically, physically, and communicatively coupled to a user interface device or display 20 by communication bus or path 15 . Controller 12 and display 20 are further physically and electrically coupled to a supply of electrical voltage 22 , such as a vehicle battery, which selectively provides electrical power to assembly 10 .
- electrical voltage 22 such as a vehicle battery
- memory portion 14 comprises a conventional and commercially available memory “unit” or memory assembly, including both permanent and temporary “address selectable” memory sections, and being adapted to selectively store and/or contain at least a portion of the operating software program which directs the operation of processor 12 and assembly 10 .
- memory 14 is also adapted to selectively store other types of data or information, including but not limited to, historical operating and processing data.
- controller 12 and memory 14 may comprise several commercially available, conventional, and selectively programmable and/or selectively arrayed “chips” or devices which are operatively and communicatively linked in a cooperative manner.
- Vehicle attribute sensors 16 comprise conventional and commercially available sensors which measure and/or selectively acquire certain information associated with the vehicle 11 .
- these sensors 16 measure and/or sense such vehicle attributes/characteristics as the vehicle speed, the engine speed, the current direction of vehicle travel, the steering angle, throttle position, turn signal light illumination, and/or the roll, pitch and/or yaw type movements of selected portions and/or components of the vehicle 11 .
- Sensors 16 cooperatively provide this selectively measured and/or sensed vehicle attribute data or information to controller 12 by use of communications bus or path 26 .
- “Surrounding area” or “environmental” sensors 18 comprise conventional and commercially available sensors which are selectively disposed within, upon, and/or around the vehicle 11 and which cooperatively measure and/or acquire certain information pertaining to certain “areas” or locations which are external to and/or which form a portion of the environment that the vehicle 11 resides within.
- Such acquired information includes but is not limited to the location and certain attributes/characteristics of objects, such as object 27 , which is proximately located to the vehicle 11 and which is resident within a certain “region of interest” or within a certain predefined area 29 .
- Each of these deployed sensors has an operative range (e.g., a maximum distance from its respective deployed position upon vehicle 11 that it “senses” objects within).
- Each of these ranges are “modifiable” or selectively programmable by the controller 12 .
- each of the sensors 18 are positioned upon vehicle 12 in a manner which allows the sensors 18 to cooperatively provide information regarding the surrounding area of vehicle 11 (e.g., in one non-limiting embodiment, controller 12 modifies the range and the angle of certain sensors 18 and selectively uses and/or interrogates only these certain sensors, thereby forming a “region of interest” which is defined in this non-limiting example, by the totality of the monitored areas which the interrogated sensors 18 are capable of and are currently programmed to sense objects within).
- controller 12 modifies the range and the angle of certain sensors 18 and selectively uses and/or interrogates only these certain sensors, thereby forming a “region of interest” which is defined in this non-limiting example, by the totality of the monitored areas which the interrogated sensors 18 are capable of and are currently programmed to sense objects within).
- sensors 18 may include one or more conventional and commercially available radar, laser, ultrasound, acoustical, video, and/or infrared sensors which selectively measure and/or acquire information such as the location, size, shape, speed, range, and direction of travel of objects (e.g., such as object 27 ) located within a certain distance of the vehicle and/or within a certain predefined “region of interest” 29 , as illustrated in FIGS. 1 and 2.
- objects include, but are not limited to, other vehicles, barriers, walls, trees, rocks, pedestrians, animals, and street lights.
- sensors 18 also cooperatively measure the direction and condition of the road 21 upon which the vehicle 11 traverses (e.g., the path and width of the road 21 , lane markers 23 , or the existence of potholes, ice, water or snow upon the road). Sensors 18 may also selectively include conventional temperature, moisture, and light sensors for respectively determining the temperature and/or weather conditions outside of the vehicle 11 (e.g., rain, snow, sleet), as well as the amount of visible light outside the vehicle 11 (e.g., whether the vehicle 11 is being currently driven during the day or the night). It should be appreciated that sensors 18 may include and/or be capable of providing one or more sensing functions, thereby individually measuring a plurality of object characteristics, such as the size, range and velocity of an object 27 .
- object characteristics such as the size, range and velocity of an object 27 .
- Display 20 comprises a conventional and commercially available electronic output display device, such as and without limitation a flat panel display, a liquid crystal display, a laser or holographic or “heads up” type, a video display, or virtually any other type of computer image type display which is suitable to display electronic and/or computerized output data or information which selectively emanates from and/or is generated by assembly 10 (e.g., by and/or from processor 12 and/or from memory 14 ).
- a flat panel display such as and without limitation a flat panel display, a liquid crystal display, a laser or holographic or “heads up” type, a video display, or virtually any other type of computer image type display which is suitable to display electronic and/or computerized output data or information which selectively emanates from and/or is generated by assembly 10 (e.g., by and/or from processor 12 and/or from memory 14 ).
- Display 20 is preferably mounted within the passenger compartment 13 of the vehicle 11 in a position which allows the driver 15 to easily view the display 20 , such as on or within the vehicle instrument panel.
- display 20 comprises a laser or holographic type display, and this display is projected directly onto the windshield 17 or within the driver's field of view. In this manner, the driver 15 is not required to substantially turn or articulate his or her “line of vision” substantially away from the road 21 to view the display.
- Receiver 24 comprises a conventional and commercially available telecommunications device or assembly which is adapted to selectively receive electromagnetic signals and to communicate at least some of the received signals to controller 12 by the use of communications bus 26 .
- receiver 24 is adapted to selectively receive electromagnetic signals from conventional roadside sensors, traffic information broadcast assemblies/devices, and transmissions from a conventional and orbiting satellite (not shown).
- User input device 28 comprises a conventional and commercially available input device such as and without limitation a series of selectively depressible “push buttons”, a keyboard, a “touch pad”, a microphone and/or virtually any other conventional and commercially available device which is suitable to selectively permit a user (typically the driver 15 ) or passenger of the vehicle 11 , to selectively “enter” and/or to communicate data and/or commands into processor 12 and/or memory array 14 .
- driver 15 may selectively “program” or create the “region of interest” 29 by use of device 28 .
- vehicle attribute data 32 is selectively and cooperatively detected, acquired, and/or measured by sensors 16 .
- data 32 describes the present attributes and/or characteristics of the vehicle 11 , such as the speed of the vehicle 11 , the direction of travel of the vehicle 11 , the rate with which the vehicle 11 is presently “turning”, and/or the rate with which the vehicle 11 is changing or altering its direction.
- the data 32 is acquired by and communicated from sensors 16 to controller 12 by use of communications bus 26 .
- the communicated data 32 is processed and selectively used by controller 12 , in one non-limiting embodiment, to determine and/or to dynamically configure a relevant area or a “region of interest” 29 .
- Data 34 represents “surrounding area” or environment data which is cooperatively acquired, detected, and/or measured by the sensors 18 .
- data 34 represents and/or comprises the identity and certain characteristics of objects 27 located within the environment of the vehicle 11 .
- Data 34 is communicated from sensors 18 to controller 12 by use of communications bus 26 (or other communication mediums), and controller 12 processes the data 34 along with the received data 32 in order to determine which of the identified or “sensed” objects 27 will be displayed to the driver 15 (e.g., only objects 27 which meet certain “relevance criteria” will be displayed) and what display type attributes should be given to those objects 27 .
- assembly 10 selectively displays (upon display 20 ) certain information and/or symbols associated with the objects 27 which are located within the “region of interest” and which are deemed to be “relevant”. As more fully explained below, all of the selected and relevant objects 27 are displayed by the use of representative symbols or icons in order to reduce the amount of extraneous information which is presented to the driver 15 and to concomitantly reduce the time and the amount of cognitive attention required by the driver 15 to interpret the displayed information.
- the displayed icons are also dynamically modified by assembly 10 in accordance with the changing nature of the sensed or measured attributes of these objects 27 and in accordance with changes in the respectively measured spatial relationships between these objects 27 and the vehicle 11 .
- the shape of the sensed and selected object 27 will determine the type of object representative icon which is selectively displayed to the driver 15 .
- the relative size and/or range of the sensed and selected object 27 will determine the overall size of the presented icon.
- the range of the object 27 (e.g., the current distance that object 27 resides from vehicle 11 ) will determine the location which the icon is placed upon display 12 as well as the size of the produced icon (e.g., the icon will be smaller if the object is relatively “far” from the vehicle and will be larger if the object is relatively “close” to the vehicle 11 ).
- Selected “special attributes” of the sensed and selected object 27 e.g., stationary positioned objects, relatively high velocity objects, erratically travelling objects, and/or objects having a collision potential with vehicle 11
- step 42 of flow diagram 40 assembly 10 receives “vehicle attribute” data 32 which is communicated to controller 12 from sensors 16 by use of the communications bus 26 or another communications medium.
- step 44 follows step 42 , and in this step 44 , controller 12 processes the received data 32 and, based upon this data, determines and/or “dynamically configures” a relevant area or “region of interest” 29 which is proximate to the vehicle 11 .
- controller 12 uses the sensed and/or measured speed of the vehicle 11 (e.g., the speedometer sensor data), the direction of travel of the vehicle 11 (e.g., forward or reverse), and the rate of change of the direction of travel of the vehicle 11 (e.g., steering wheel sensor, accelerometer, and/or processed vision data) to determine and/or to dynamically and automatically create and configure the “region of interest” 29 without intervention on the part of the driver 15 or any of the other vehicle occupants.
- the sensed and/or measured speed of the vehicle 11 e.g., the speedometer sensor data
- the direction of travel of the vehicle 11 e.g., forward or reverse
- the rate of change of the direction of travel of the vehicle 11 e.g., steering wheel sensor, accelerometer, and/or processed vision data
- controller 12 will dynamically and automatically, without intervention of the driver 15 or other vehicle occupants, extend the “region of interest” 29 further in the direction of travel of the vehicle (e.g., approximately 100 meters in front of the vehicle 11 ). If the vehicle 11 is traveling at a very slow speed or is parking, the created and/or defined “region of interest” 29 will extend only a relatively small distance around the vehicle 11 (e.g., several meters). While the vehicle 11 is in reverse, the “region of interest” 29 will extend primarily behind the vehicle 11 . If the vehicle 11 is turning, the “region of interest” 29 will be extended in the direction of the vehicle turn.
- Controller 12 dynamically, continually, and automatically adjusts or recalculates the “region of interest” in substantially and/or approximate “real time” based upon the vehicle's speed, direction and steering sensor inputs and/or in accordance with other measured vehicle attributes.
- controller 12 recalculates the “region of interest” once every ten seconds or once every other programmable and selectively determined period of time which may be dissimilar to the foregoing ten second or “real time” embodiments.
- the “region of interest” 29 is generally circular or elliptical, being defined as the totality of the currently configured operative ranges and, in another non-limiting embodiment, the totality of operative angles of the deployed environmental sensors 18 , and having a monitored area or volume which varies as a function of the vehicle's speed and direction.
- controller 12 and sensors 18 cooperatively create a generally circular “region of interest” 29 around the vehicle 11 having a radius 31 of a predetermined length based upon the speed of the vehicle (e.g., 25 meters).
- “region of interest” 29 may have a certain volume (e.g., the monitored area may have a monitored height component).
- the controller 12 increases the radius 31 of the “region of interest” 29 only in the general direction of travel of the vehicle 11 and by an amount which is proportional to the increase of speed of the vehicle 11 (e.g., if the vehicle 11 is traveling twice as fast, the radius 31 of the “region of interest” 29 in front of the vehicle 11 will increase to 100 meters or twice as far as it was before the increase in speed occurred).
- the determination or definition of the “region of interest” 29 is further modified by certain of the sensors 18 , such as those of sensors 18 which measure or detect “cross-roads” or intersections within the path of travel of the vehicle 11 and environmental conditions.
- the “region of interest” 29 in the presence of an intersection, is extended further in the directions of the intersecting roadways, and in the presence of icy or wet conditions, the “region of interest” 29 is extended further in the vehicle's direction of travel.
- the “region of interest” 29 is of a predetermined configuration based upon certain vehicle attributes (e.g., vehicle speed)and upon sensing these attribute values, controller 12 creates the associated and predetermined “region of interest” 29 .
- assembly 10 While receiving vehicle attribute data 32 , as shown in step 42 , assembly 10 concurrently receives data 34 , which comprises environment or “surrounding area” data which is acquired, detected and/or measured by the sensors 18 and communicated to processor or controller 12 , as shown in step 46 .
- data 34 comprises environment or “surrounding area” data which is acquired, detected and/or measured by the sensors 18 and communicated to processor or controller 12 , as shown in step 46 .
- the sensors 18 are substantially always “activated” or made to acquire data at substantially the same interval of time in order to adequately warn driver 15 of impending danger (e.g., even though, in one non-limiting example, the “region of interest” 29 extends in the front of vehicle 11 , the sensors 18 which detect objects in the rear of the vehicle 11 are still activated and are capable of interrupting controller 12 with a warning signal identifying a relatively high speed object which may impact the rear of the vehicle 11 ).
- the number and type of sensors 18 which are activated and used to create a “region of interest” 29 and to measure and/or acquire data 34 varies according to the current operating mode, environmental conditions and speed of the vehicle 11 .
- controller 12 automatically and dynamically interrogates primarily those sensors 18 which are disposed in the rear of the vehicle 11 or which sense objects located behind the vehicle 11 .
- controller 12 automatically and dynamically interrogates primarily only those of sensors 18 which are relatively “short-range” sensors (e.g., infrared and video sensors), and when the vehicle 11 is on the highway or traveling at a relatively high rate of speed, controller 12 primarily, automatically, and dynamically interrogates those sensors 18 which are relatively “long-range” sensors (e.g., radar, laser, and ultrasound sensors).
- the data received by sensors 18 is processed by controller 12 , and the location or coordinates of the object sensed, identified, and/or detected is determined using, in one non-limiting embodiment, a conventional signal processing algorithm within step 48 .
- a conventional signal processing algorithm within step 48 .
- Various types of signal processing algorithms may be utilized.
- Step 50 follows step 48 and, in this step 50 , controller 12 compares the location of each sensed object 27 with the current calculated and/or defined “region of interest” 29 . If the currently measured and/or positioned coordinates of the identified object 27 are not within the range of coordinates defining the currently defined “region of interest” 29 , the attribute data 34 representing that object 27 is discarded, in step 52 . If the detected object 27 currently resides within the “region of interest” 29 , the data 34 representing that object 27 is further processed by controller 12 within step 54 .
- controller 12 acquires and/or identifies certain attributes and characteristics of each sensed object 27 residing in the “region of interest” 29 , based upon the respectively received data 34 .
- sensed or acquired object attribute data include the size and shape of the object 27 , the velocity of the object 27 , the direction (if any) that the object 27 is currently traveling, and the temperature of the object 27 .
- controller 12 “translates” or assigns certain mathematical values to this data 34 . Controller 12 selectively stores this “translated” data within memory 14 .
- Step 56 follows step 54 and, in this step 56 , a “relevance analysis” is accomplished upon each of the identified objects 27 which are utilized within step 54 .
- assembly 10 determines whether each of the objects 27 , based upon their respective “translated” data and data values, are relevant or useful to the driver 15 of the vehicle 11 .
- Assembly 10 first “qualifies” each sensed and/or identified object 27 as being “relevant” in the manner described below.
- Substantially all data describing the road or highway on which the vehicle is traveling is deemed to be “relevant” and controller 12 retains this “road” data for further processing.
- this “road” data is recognized or identified by controller 12 based upon the identity of those sensors 18 which provide this information. That is, certain of the sensors 18 and/or portions of receiver 24 are assigned to monitor only road conditions and attributes. Data originating from these sensors and/or portions of receiver 24 , which are received by controller 12 , are automatically determined to be within the “region of interest” 29 and are automatically “qualified” as being relevant by controller 12 .
- All other data 34 is analyzed by assembly 10 (e.g., by controller 12 ) to determine whether it “matches” or “meets” various predetermined “relevance criteria” values, which are stored within a relevance database or matrix, selectively held and/or stored within memory 14 .
- the relevance criteria values represent and/or comprise data values or ranges of values respectively describing and/or defining object size and object location with respect to vehicle 11 .
- the “translated data”, for each identified object 27 is first compared with a certain relevance criteria threshold in order to determine if it respectively matches or exceeds these relevance criteria threshold values (e.g., in one non-limiting example, controller 12 uses a “size threshold” to analyze the acquired data).
- Objects 27 having sensed size or positional values which match or exceed the respective and predetermined “minimal” relevance criteria threshold values are retained or stored within memory 14 for further processing.
- the object 27 does not have sensed values which meet at least one (e.g., in another non-limiting embodiment both or all threshold values must be met or exceeded) of these “minimal” relevance criteria threshold values, the data associated with the sensed object 27 is discarded within step 58 . If the sensed data associated with each object 27 does respectively meet the “minimal” threshold values, its respective attribute data values are further compared to a predetermined “upper threshold” relevance criteria values (e.g., again corresponding to object size and position).
- the object 27 If the respectively sensed object 27 has sensed attribute values which respectively match or exceed at least one of these upper values (e.g., relatively large objects such as a tree, a car, or a wall generally meet or exceed these relevance criteria values), the object 27 is automatically “qualified” as being “relevant” by the assembly 10 and the sensed data relating to that object 27 is retained or stored within memory 14 for further processing.
- Objects 27 which have a respectively sensed attribute values which are respectively less than the “upper threshold” values, but are greater than “minimal threshold” values (e.g., “potentially relevant objects”) are further analyzed based upon their present and potentially future location with respect to the vehicle 11 .
- controller 12 determines whether the projected path of the vehicle 11 and the projected and respective path of each of the potentially relevant objects 27 will cause the respective and potentially relevant objects 27 to either intersect or collide with the vehicle 11 , or pass within a certain predetermined distance of the vehicle 11 (e.g., within 10 meters or some other programmable and/or modifiable distance).
- the controller 12 determines that there will be a likelihood of a collision between a potentially relevant object 27 and the vehicle 11 , or that a potentially relevant object 27 will pass within the certain predetermined and programmable distance of the vehicle 11 , the respective potentially relevant object 27 is “qualified” as being relevant by assembly 10 and the data relating to the “qualified” object 27 is retained for further processing. Additionally, in the preferred embodiment, assembly 10 will consider an object 27 to be “qualified” if the direction or path of the object 27 is erratic, uncertain, and/or unpredictable by controller 12 .
- substantially all of the sensed data 34 respectively relating to each “qualified” or “relevant” objects 27 is used to match a respective object 27 with a representative icon, as illustrated by step 60 .
- controller 12 compares the stored object attribute data values relating to the shape of each respective relevant object 27 with a database table or matrix containing predetermined values or ranges of values representing patterns, dimensions, and/or shapes which are associated with particular objects (e.g., trees, cars, rocks, lane markers, pedestrians, animals, construction barriers, bridges). Each range of values is assigned to and indicative of a particular type of object 27 .
- controller 12 uses a standard “pattern recognition” algorithm which, in one non-limiting embodiment is a conventional algorithm, to compare the dimension and/or shape values of each “qualified” object 27 to those values contained within the database table. If the shape values of a “qualified” object 27 match or fall with the range assigned to a particular object type in the table, the “qualified” object 27 is assigned a display icon which is representative of that type of object (e.g., trees are assigned a “tree-shaped” icon, cars are assigned “car-shaped” icons). If the shape of the qualified or relevant object 27 does not match any of the value ranges held within the table, an “unidentified” icon (e.g., a question mark or some other indicative symbol) is assigned to the object.
- a standard “pattern recognition” algorithm which, in one non-limiting embodiment is a conventional algorithm, to compare the dimension and/or shape values of each “qualified” object 27 to those values contained within the database table. If the shape values of a “qualified” object 27 match or fall with the range assigned to a
- controller 12 applies display attributes to the icon which are representative of the object's sensed attributes/characteristics, within step 62 .
- controller 12 accesses the retained size, velocity, location, and trajectory data related to the object 27 and dynamically modifies the icon accordingly, in a manner designed and effective to ensure the continued accuracy of the displayed icon or symbol.
- controller 12 uses a conventional scaling “program” and/or algorithm to selectively increase and/or decrease the size of the displayed icon in order to accurately represent the relative size and range of the object 27 (e.g., controller 12 increases the size of the standard “vehicle” icon for relatively large vehicles, and decrease the size of the standard “vehicle” icon for relatively small automobiles).
- controller 12 increases the size of the standard “vehicle” icon for relatively large vehicles, and decrease the size of the standard “vehicle” icon for relatively small automobiles.
- the actual size and range of the detected object 27 determines the size of the respective icon displayed by assembly 10 .
- the range of the object 27 determines the location of the icon's placement upon display 20 relative to the vehicle's representative icon (the vehicle 11 is assigned an icon which is disposed generally within the lower center of the display 20 ).
- controller 12 further assigns different attributes to the selectively displayed icons depending upon the sensed velocity of the identified objects 27 .
- objects 27 moving at a relatively fast velocity are displayed in the color of red
- stationary objects 27 are displayed in the color of blue
- relatively slow moving objects 27 are displayed in the color of yellow.
- the respective colors of the icons also change (e.g., an object 27 which is initially stationary and then accelerates to move at a high speed has an icon which changes color from blue to red).
- objects 27 having an erratic velocity and/or relatively high collision potential will be displayed as “flashing” or “blinking” icons, in order to effectively warn the driver 15 or passengers of vehicle 11 of a potential hazard.
- the respective icons are displayed upon display 20 .
- the respective icons which are assigned to each of the “qualified” objects 27 are communicated to display 20 .
- Display 20 displays the vehicle 11 (which is assigned an icon), the road upon which the vehicle 11 traverses, and all other “qualified” objects 27 within the “region of interest” 29 .
- the assembly 10 e.g. controller 12
- the “region of interest” 29 may be displayed in one of several user selectable informational display formats or views.
- a driver 15 may enter the format of his or her choice by selective use of the data/command input device 28 .
- driver 15 or another vehicle occupant may select from a top view format (See FIG. 5), which is a view from above the vehicle 15 , a perspective view format (see FIG. 6), which a view from above and behind the vehicle 11 , or an isometric view format (see FIG.
- FIGS. 5 - 10 which is a view from above, behind and either to the left or to the right of the vehicle 11 , depending on which side of the road the vehicle 11 is traveling (e.g., if the vehicle 11 travels in the right hand lane, such as in England, the isometric view is “taken” over the right shoulder of the driver 15 toward the center of the road, alternatively, the view is from the left shoulder of the driver 15 ). Examples of each of these formats are illustrated in FIGS. 5 - 10 .
- FIGS. 5 and 8 illustrate two different regions of interest displayed in the top view informational display format (e.g., the display which is shown in FIG. 5 has been dynamically adjusted in accordance with an updated “region of interest” 29 , thereby causing the display of FIG. 8 to be presented by assembly 10 ).
- icon 102 represents the vehicle 11 equipped with system 10 .
- Icons 104 , 106 represent other vehicles sensed within the “region of interest”.
- Icon 108 represents a tree
- icon 110 represents an unidentified “qualified” or “relevant” object
- icons 112 represent lane markers.
- Screens 200 and 300 respectively shown in FIGS.
- FIG. 6 and 7 illustrate substantially the same “region of interest” 29 which is shown upon screen 100 but displayed in respective perspective and isometric view display type formats.
- Icons representing the same objects 27 are defined by the same reference numerals as delineated in screen 100 of FIG. 5 with the exception that in screen 200 the reference numerals are incremented by 100 .
- screen 300 of FIG. 7 the reference numerals are incremented by 200 .
- icon 402 represents the vehicle 11 equipped with assembly 10
- icon 404 represents a vehicle sensed within the “region of interest”
- icon 406 represents a tree
- icon 408 represents an unidentified “qualified” object
- icons 410 represent lane markers.
- Screens 500 (FIG. 9) and 600 (FIG. 10) illustrate the same “region of interest” 29 shown in screen 400 , but displayed in perspective and isometric view informational display type formats, respectively. Icons representing the same objects are defined by the same reference numerals as delineated in screen 400 of FIG. 4 with the exception that in screen 500 the reference numerals are incremented by 100 , and in screen 600 the reference numerals are incremented by 200 .
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Traffic Control Systems (AREA)
Abstract
Description
- This invention relates to a vehicle information acquisition and display assembly and more particularly to an assembly for use within a vehicle, which is adapted to selectively and automatically create and/or define a “region of interest”, and which is further adapted to selectively acquire and display information relating to and/or representing certain objects located within the created and/or defined “region of interest”.
- It is desirable to provide a driver of a vehicle with some information associated with, representing, and/or describing a portion of the area surrounding the vehicle or the “environment” in which the vehicle is disposed within, thereby identifying potential threats, objects, and/or hazards to the driver and significantly improving the driver's ability to avoid an accident or other misfortune.
- Some efforts have been previously made to improve the driver's awareness or knowledge of the vehicle's environment. Particularly, these prior efforts include providing and selectively installing “vision aiding devices” such as mirrors, lights, or windows upon the vehicle, in order to improve the driver's range of vision. These devices and/or assemblies provide the driver with information concerning only a rather limited portion of the vehicle environment and often include a number of undesirable “blind spots” or areas for which no information or image is provided.
- Another prior method or technique of increasing the driver's awareness or knowledge of the area proximate to the vehicle (or of the vehicle's environment) requires the installation of a number of sensors upon and/or within the vehicle. Particularly, these selectively installed sensors provide certain information to the driver and warn the driver if the vehicle is close to contacting an object (e.g., if the vehicle is about to “back into” the object)
- The reduction in the overall cost of these sensors has allowed and/or has motivated vehicle manufacturers to use these sensors more extensively within and/or upon their respectively produced vehicles. Examples of such sensors include radar, laser, ultrasound, and/or infrared sensors and/or a conventional and commercially available camera. While the increased use of these sensors has indeed allowed the driver to gain a more complete view of some portion of or all of the area immediately and/or proximately surrounding the vehicle, such use has also undesirably increased the danger or the probability of the driver becoming undesirably “overloaded” with the provided information.
- Particularly, the relatively large number of sensors used in certain vehicles often and undesirably “bombards” and/or confuses the driver with an overabundance of substantially “real-time” information, including much information that has little or no relevance or importance to the driver (e.g., images of stationary objects which are remotely located from the vehicle). This driver “information overload” decreases the ability of the driver to discern information which is truly useful to the driver or which describes potential or imminent hazards; the truly relevant or important information being “lost” or obscured by all of the other data or information which is substantially and simultaneously presented to the driver. This driver “information overload” also increases the probability of a collision due to the great amount of time needed by the driver to decipher or review all of the provided information, thereby substantially preventing or hindering the driver from attending to and/or concentrating “on the road” and on the task of safely maneuvering the vehicle.
- These prior techniques and/or assemblies also are generally “static”. That is, the monitored portion of the vehicle environment or area proximately surrounding the vehicle is typically “fixed” and static, and not readily susceptible to change or modification. Hence, these prior techniques and/or assemblies were not and are not “dynamically configurable”, in that their respective monitored area or portion of the vehicle environment is not and was not automatically and/or dynamically modified to suit the ever-changing needs of the driver, based upon certain driving conditions and/or vehicle attributes. For example, a driver controlling a vehicle which is travelling upon a highway at a speed of70 miles per hour has different informational needs than the driver does when turning the vehicle at about 10 miles per hour. Hence, these prior techniques and/or assemblies were not very useful in many instances.
- There is therefore a need for a vehicle information system which acquires and provides sufficient information related to the vehicle's environment to adequately assist the driver to avoid a collision without “overloading” the driver with extraneous, non-relevant and/or “non-helpful” types of information. There is a further need for a vehicle information system which selectively creates a dynamically configurable monitored area which provides relevant information to the driver concerning and/or representing objects residing within this dynamically configurable area.
- It is a first object of the invention to provide a vehicle information assembly which overcomes many, if not all, of the previously delineated drawbacks of such prior systems, devices, techniques, and/or methods.
- It is a second object of the invention to provide a vehicle information assembly for use with a vehicle and which is adapted to create a dynamically configurable “region of interest”, to acquire information associated with and/or describing objects which reside within the created “region of interest”, and which selectively displays some of the acquired information which the system considers to be relevant and useful to the vehicle driver.
- It is a third object of the invention to provide a vehicle information assembly which is adapted to acquire information describing the environment within which the vehicle resides, which “pre-screens” or “filters” this acquired information by use of certain “relevance criteria” and which selectively creates icons and/or symbols which are selectively displayed to the driver by use of the certain “relevance criteria”.
- It is a fourth object of the invention to provide a vehicle information assembly for use by a driver of a vehicle and which selectively presents relevant information regarding and/or relating to the area surrounding the vehicle in a substantially clear and substantially unambiguous graphical form.
- According to a first aspect of the invention, a vehicle display assembly for use within a vehicle is provided. The vehicle is selectively driven in proximity to at least one object. The display assembly includes at least one sensor which senses the at least one object and which provides an output signal having a certain value; and a processor which is coupled to the at least one sensor, which contains at least one object criteria value, which receives the output signal, and which compares the certain value of the output signal to the at least one object criteria value and, based upon the comparison, which selectively generates and displays at least one icon representing the at least one object.
- According to a second aspect of the invention, a method of displaying information related to an object located in proximity to a vehicle is provided. The vehicle is selectively travelling at a certain speed and at a certain direction. The method includes the steps of providing at least one sensor which measures the speed and direction of the vehicle; providing a controller for selectively creating a “region of interest” around the vehicle based upon the measured speed and the direction of the vehicle; providing at least one sensor for measuring the location of the object and for measuring the size of the object; determining whether the object resides within the “region of interest”; providing an icon; and displaying the icon only if the object resides within the “region of interest”.
- Further objects, features, and advantages of the present invention will become apparent from the following detailed description of the preferred embodiment of the invention and by reference to the following drawings.
- For a fuller and more complete understanding of the nature and the objects of the present invention, reference should now be had to the accompanying drawings. It should be apparent to those of ordinary skill in the art that the accompanying drawings are included for the purpose of clarifying Applicants' invention and are not intended, nor should they be construed, as limiting Applicants' invention in any manner whatsoever. Particularly, the following drawings delineate, in a non-limiting manner, the following aspects of Applicants' invention:
- FIG. 1 is a block diagram of a vehicle information assembly which is selectively deployed within a conventional vehicle and which is made in accordance with the teachings of the preferred embodiment of the invention;
- FIG. 2 is a top view of the vehicle which is shown in FIG. 1;
- FIG. 3 is a block diagram illustrating certain broad functional aspects of the vehicle information assembly which is shown in FIG. 1;
- FIG. 4 is a block diagram illustrating certain detailed functional aspects of the vehicle information assembly which is shown in FIG. 1;
- FIG. 5 illustrates one example of a user interface or a display screen which is used by the vehicle information assembly which is shown in FIG. 1 and further illustrating the selective display of data in a “top view” type of informational display format;
- FIG. 6 illustrates a second example of a user interface or a screen which is used by the vehicle information assembly which is shown in FIG. 1 and further illustrating the selective display of data in a “perspective view format” type of informational display format;
- FIG. 7 illustrates a third example of a user interface or a screen which is used by the vehicle information assembly shown in FIG. 1 and further illustrating the selective display of data in an “isometric view” type of informational display format;
- FIG. 8 illustrates a fourth example of a user interface or a screen which is used by the vehicle information assembly shown in FIG. 1 and further illustrating the selective display of data in a “top view” type of informational display format;
- FIG. 9 illustrates a fifth example of a user interface or a screen which is used by the vehicle information assembly shown in FIG. 1 and further illustrating the selective display of data in a “perspective view” type of informational display format; and
- FIG. 10 illustrates a sixth example of a user interface or a screen which is used by the vehicle information assembly shown in FIG. 1 and further illustrating the selective display of data in an “isometric view” type of informational display format.
- Referring now to FIG. 1, there is shown an information acquisition and
display assembly 10 for use within avehicle 11 and made in accordance with the teachings of the preferred embodiment of the invention. As shown, system orassembly 10 includes a conventional and commercially available microprocessor, microcontroller orcontroller 12 having a memory portion 14 and operating under stored program control. More particularly,controller 12 is electrically, physically, and communicatively coupled to “vehicle attribute”sensors 16, “surrounding area” or “environmental” data/information acquisition sensors 18, areceiver 24, and auser input device 28, by use of at least one communications bus orpath 26.Controller 12 is electrically, physically, and communicatively coupled to a user interface device or display 20 by communication bus orpath 15.Controller 12 anddisplay 20 are further physically and electrically coupled to a supply ofelectrical voltage 22, such as a vehicle battery, which selectively provides electrical power toassembly 10. - In the preferred embodiment of the invention, memory portion14 comprises a conventional and commercially available memory “unit” or memory assembly, including both permanent and temporary “address selectable” memory sections, and being adapted to selectively store and/or contain at least a portion of the operating software program which directs the operation of
processor 12 andassembly 10. Moreover, memory 14 is also adapted to selectively store other types of data or information, including but not limited to, historical operating and processing data. More particularly, examples of such data include, but are not limited to, data defining or selectively “fixing” the current “region of interest” proximate to the vehicle 11 (the “region of interest” as explained below, is defined as the portion of the vehicle environment which is currently and/or which is to be monitored by the deployed assembly 10) and data relating to the identification of and/or relevance of certain objects which reside within the current or perhaps one of the previously defined “regions of interest”. Moreover, as should also be apparent to those of ordinary skill in the art,controller 12 and memory 14 may comprise several commercially available, conventional, and selectively programmable and/or selectively arrayed “chips” or devices which are operatively and communicatively linked in a cooperative manner. - “Vehicle attribute”
sensors 16 comprise conventional and commercially available sensors which measure and/or selectively acquire certain information associated with thevehicle 11. For example and without limitation, thesesensors 16 measure and/or sense such vehicle attributes/characteristics as the vehicle speed, the engine speed, the current direction of vehicle travel, the steering angle, throttle position, turn signal light illumination, and/or the roll, pitch and/or yaw type movements of selected portions and/or components of thevehicle 11.Sensors 16 cooperatively provide this selectively measured and/or sensed vehicle attribute data or information to controller 12 by use of communications bus orpath 26. - “Surrounding area” or “environmental”
sensors 18 comprise conventional and commercially available sensors which are selectively disposed within, upon, and/or around thevehicle 11 and which cooperatively measure and/or acquire certain information pertaining to certain “areas” or locations which are external to and/or which form a portion of the environment that thevehicle 11 resides within. Such acquired information includes but is not limited to the location and certain attributes/characteristics of objects, such asobject 27, which is proximately located to thevehicle 11 and which is resident within a certain “region of interest” or within a certainpredefined area 29. Each of these deployed sensors has an operative range (e.g., a maximum distance from its respective deployed position uponvehicle 11 that it “senses” objects within). Each of these ranges (respective monitored distance from the vehicle 11), and the respective angle (e.g., the monitored “width” and the “height” of each respective sensor) in the preferred embodiment of the invention, are “modifiable” or selectively programmable by thecontroller 12. In the preferred embodiment of the invention, each of thesensors 18 are positioned uponvehicle 12 in a manner which allows thesensors 18 to cooperatively provide information regarding the surrounding area of vehicle 11 (e.g., in one non-limiting embodiment,controller 12 modifies the range and the angle ofcertain sensors 18 and selectively uses and/or interrogates only these certain sensors, thereby forming a “region of interest” which is defined in this non-limiting example, by the totality of the monitored areas which the interrogatedsensors 18 are capable of and are currently programmed to sense objects within). - For example and without limitation,
sensors 18 may include one or more conventional and commercially available radar, laser, ultrasound, acoustical, video, and/or infrared sensors which selectively measure and/or acquire information such as the location, size, shape, speed, range, and direction of travel of objects (e.g., such as object 27) located within a certain distance of the vehicle and/or within a certain predefined “region of interest” 29, as illustrated in FIGS. 1 and 2. Examples of such objects include, but are not limited to, other vehicles, barriers, walls, trees, rocks, pedestrians, animals, and street lights. Thesesensors 18 also cooperatively measure the direction and condition of theroad 21 upon which thevehicle 11 traverses (e.g., the path and width of theroad 21,lane markers 23, or the existence of potholes, ice, water or snow upon the road).Sensors 18 may also selectively include conventional temperature, moisture, and light sensors for respectively determining the temperature and/or weather conditions outside of the vehicle 11 (e.g., rain, snow, sleet), as well as the amount of visible light outside the vehicle 11 (e.g., whether thevehicle 11 is being currently driven during the day or the night). It should be appreciated thatsensors 18 may include and/or be capable of providing one or more sensing functions, thereby individually measuring a plurality of object characteristics, such as the size, range and velocity of anobject 27. -
Display 20 comprises a conventional and commercially available electronic output display device, such as and without limitation a flat panel display, a liquid crystal display, a laser or holographic or “heads up” type, a video display, or virtually any other type of computer image type display which is suitable to display electronic and/or computerized output data or information which selectively emanates from and/or is generated by assembly 10 (e.g., by and/or fromprocessor 12 and/or from memory 14). -
Display 20 is preferably mounted within thepassenger compartment 13 of thevehicle 11 in a position which allows thedriver 15 to easily view thedisplay 20, such as on or within the vehicle instrument panel. In an alternate embodiment of the invention,display 20 comprises a laser or holographic type display, and this display is projected directly onto thewindshield 17 or within the driver's field of view. In this manner, thedriver 15 is not required to substantially turn or articulate his or her “line of vision” substantially away from theroad 21 to view the display. -
Receiver 24 comprises a conventional and commercially available telecommunications device or assembly which is adapted to selectively receive electromagnetic signals and to communicate at least some of the received signals tocontroller 12 by the use ofcommunications bus 26. In one embodiment of the invention,receiver 24 is adapted to selectively receive electromagnetic signals from conventional roadside sensors, traffic information broadcast assemblies/devices, and transmissions from a conventional and orbiting satellite (not shown). -
User input device 28 comprises a conventional and commercially available input device such as and without limitation a series of selectively depressible “push buttons”, a keyboard, a “touch pad”, a microphone and/or virtually any other conventional and commercially available device which is suitable to selectively permit a user (typically the driver 15) or passenger of thevehicle 11, to selectively “enter” and/or to communicate data and/or commands intoprocessor 12 and/or memory array 14. In one non-limiting embodiment of the invention,driver 15 may selectively “program” or create the “region of interest” 29 by use ofdevice 28. - To understand the general operation of
vehicle information assembly 10, reference is now made to flowchart 30 of FIG. 3, which illustrates and/or represents a broad functional overview ofassembly 10. As shown, “vehicle attribute data” 32 is selectively and cooperatively detected, acquired, and/or measured bysensors 16. Particularly, in the preferred embodiment of the invention,data 32 describes the present attributes and/or characteristics of thevehicle 11, such as the speed of thevehicle 11, the direction of travel of thevehicle 11, the rate with which thevehicle 11 is presently “turning”, and/or the rate with which thevehicle 11 is changing or altering its direction. Thedata 32 is acquired by and communicated fromsensors 16 tocontroller 12 by use ofcommunications bus 26. The communicateddata 32 is processed and selectively used bycontroller 12, in one non-limiting embodiment, to determine and/or to dynamically configure a relevant area or a “region of interest” 29. -
Data 34 represents “surrounding area” or environment data which is cooperatively acquired, detected, and/or measured by thesensors 18. Particularly, in this embodiment,data 34 represents and/or comprises the identity and certain characteristics ofobjects 27 located within the environment of thevehicle 11.Data 34 is communicated fromsensors 18 tocontroller 12 by use of communications bus 26 (or other communication mediums), andcontroller 12 processes thedata 34 along with the receiveddata 32 in order to determine which of the identified or “sensed” objects 27 will be displayed to the driver 15 (e.g., only objects 27 which meet certain “relevance criteria” will be displayed) and what display type attributes should be given to thoseobjects 27. - As shown by
functional block assembly 10 selectively displays (upon display 20) certain information and/or symbols associated with theobjects 27 which are located within the “region of interest” and which are deemed to be “relevant”. As more fully explained below, all of the selected andrelevant objects 27 are displayed by the use of representative symbols or icons in order to reduce the amount of extraneous information which is presented to thedriver 15 and to concomitantly reduce the time and the amount of cognitive attention required by thedriver 15 to interpret the displayed information. - The displayed icons are also dynamically modified by
assembly 10 in accordance with the changing nature of the sensed or measured attributes of theseobjects 27 and in accordance with changes in the respectively measured spatial relationships between theseobjects 27 and thevehicle 11. For example and without limitation, in the preferred embodiment of the invention, the shape of the sensed and selectedobject 27 will determine the type of object representative icon which is selectively displayed to thedriver 15. The relative size and/or range of the sensed and selectedobject 27 will determine the overall size of the presented icon. The range of the object 27 (e.g., the current distance that object 27 resides from vehicle 11) will determine the location which the icon is placed upondisplay 12 as well as the size of the produced icon (e.g., the icon will be smaller if the object is relatively “far” from the vehicle and will be larger if the object is relatively “close” to the vehicle 11). Selected “special attributes” of the sensed and selected object 27 (e.g., stationary positioned objects, relatively high velocity objects, erratically travelling objects, and/or objects having a collision potential with vehicle 11) will have icons of a certain color or having other display type attributes (e.g., a certain flashing or a high intensity of the displayed color will denote these “special characteristics”). - To more fully understand the operational functionality of the preferred embodiment of
assembly 10, reference is now made to the more detailed operational flow diagram or “flow chart” 40 of FIG. 4. As shown instep 42 of flow diagram 40,assembly 10 receives “vehicle attribute”data 32 which is communicated tocontroller 12 fromsensors 16 by use of thecommunications bus 26 or another communications medium.Step 44 followsstep 42, and in thisstep 44,controller 12 processes the receiveddata 32 and, based upon this data, determines and/or “dynamically configures” a relevant area or “region of interest” 29 which is proximate to thevehicle 11. Specifically, in the preferred embodiment of the invention,controller 12 uses the sensed and/or measured speed of the vehicle 11 (e.g., the speedometer sensor data), the direction of travel of the vehicle 11 (e.g., forward or reverse), and the rate of change of the direction of travel of the vehicle 11 (e.g., steering wheel sensor, accelerometer, and/or processed vision data) to determine and/or to dynamically and automatically create and configure the “region of interest” 29 without intervention on the part of thedriver 15 or any of the other vehicle occupants. - For example and without limitation, if the
vehicle 11 is traveling at a relatively high speed,controller 12 will dynamically and automatically, without intervention of thedriver 15 or other vehicle occupants, extend the “region of interest” 29 further in the direction of travel of the vehicle (e.g., approximately 100 meters in front of the vehicle 11). If thevehicle 11 is traveling at a very slow speed or is parking, the created and/or defined “region of interest” 29 will extend only a relatively small distance around the vehicle 11 (e.g., several meters). While thevehicle 11 is in reverse, the “region of interest” 29 will extend primarily behind thevehicle 11. If thevehicle 11 is turning, the “region of interest” 29 will be extended in the direction of the vehicle turn.Controller 12 dynamically, continually, and automatically adjusts or recalculates the “region of interest” in substantially and/or approximate “real time” based upon the vehicle's speed, direction and steering sensor inputs and/or in accordance with other measured vehicle attributes. In an alternate non-limiting embodiment,controller 12 recalculates the “region of interest” once every ten seconds or once every other programmable and selectively determined period of time which may be dissimilar to the foregoing ten second or “real time” embodiments. - The “region of interest”29 is generally circular or elliptical, being defined as the totality of the currently configured operative ranges and, in another non-limiting embodiment, the totality of operative angles of the deployed
environmental sensors 18, and having a monitored area or volume which varies as a function of the vehicle's speed and direction. For example, in one non-limiting embodiment,controller 12 andsensors 18 cooperatively create a generally circular “region of interest” 29 around thevehicle 11 having aradius 31 of a predetermined length based upon the speed of the vehicle (e.g., 25 meters). In a non-limiting embodiment, “region of interest” 29 may have a certain volume (e.g., the monitored area may have a monitored height component). - As the vehicle's speed increases, the
controller 12 increases theradius 31 of the “region of interest” 29 only in the general direction of travel of thevehicle 11 and by an amount which is proportional to the increase of speed of the vehicle 11 (e.g., if thevehicle 11 is traveling twice as fast, theradius 31 of the “region of interest” 29 in front of thevehicle 11 will increase to 100 meters or twice as far as it was before the increase in speed occurred). In other non-limiting embodiments, the determination or definition of the “region of interest” 29 is further modified by certain of thesensors 18, such as those ofsensors 18 which measure or detect “cross-roads” or intersections within the path of travel of thevehicle 11 and environmental conditions. For example, in such other non-limiting embodiments, in the presence of an intersection, the “region of interest” 29 is extended further in the directions of the intersecting roadways, and in the presence of icy or wet conditions, the “region of interest” 29 is extended further in the vehicle's direction of travel. In other non-limiting embodiments, the “region of interest” 29 is of a predetermined configuration based upon certain vehicle attributes (e.g., vehicle speed)and upon sensing these attribute values,controller 12 creates the associated and predetermined “region of interest” 29. - While receiving
vehicle attribute data 32, as shown instep 42,assembly 10 concurrently receivesdata 34, which comprises environment or “surrounding area” data which is acquired, detected and/or measured by thesensors 18 and communicated to processor orcontroller 12, as shown instep 46. In one non-limiting embodiment of the invention, thesensors 18 are substantially always “activated” or made to acquire data at substantially the same interval of time in order to adequately warndriver 15 of impending danger (e.g., even though, in one non-limiting example, the “region of interest” 29 extends in the front ofvehicle 11, thesensors 18 which detect objects in the rear of thevehicle 11 are still activated and are capable of interruptingcontroller 12 with a warning signal identifying a relatively high speed object which may impact the rear of the vehicle 11). The number and type ofsensors 18 which are activated and used to create a “region of interest” 29 and to measure and/or acquiredata 34 varies according to the current operating mode, environmental conditions and speed of thevehicle 11. For example, when thevehicle 11 is in a “reverse directional type of operating mode”,controller 12 automatically and dynamically interrogates primarily thosesensors 18 which are disposed in the rear of thevehicle 11 or which sense objects located behind thevehicle 11. When thevehicle 11 is being parked,controller 12 automatically and dynamically interrogates primarily only those ofsensors 18 which are relatively “short-range” sensors (e.g., infrared and video sensors), and when thevehicle 11 is on the highway or traveling at a relatively high rate of speed,controller 12 primarily, automatically, and dynamically interrogates thosesensors 18 which are relatively “long-range” sensors (e.g., radar, laser, and ultrasound sensors). The data received bysensors 18 is processed bycontroller 12, and the location or coordinates of the object sensed, identified, and/or detected is determined using, in one non-limiting embodiment, a conventional signal processing algorithm withinstep 48. Various types of signal processing algorithms may be utilized. -
Step 50 followsstep 48 and, in thisstep 50,controller 12 compares the location of each sensedobject 27 with the current calculated and/or defined “region of interest” 29. If the currently measured and/or positioned coordinates of the identifiedobject 27 are not within the range of coordinates defining the currently defined “region of interest” 29, theattribute data 34 representing thatobject 27 is discarded, instep 52. If the detectedobject 27 currently resides within the “region of interest” 29, thedata 34 representing thatobject 27 is further processed bycontroller 12 withinstep 54. - Particularly,
controller 12, instep 54, acquires and/or identifies certain attributes and characteristics of each sensedobject 27 residing in the “region of interest” 29, based upon the respectively receiveddata 34. Examples of such sensed or acquired object attribute data include the size and shape of theobject 27, the velocity of theobject 27, the direction (if any) that theobject 27 is currently traveling, and the temperature of theobject 27. Further,controller 12 “translates” or assigns certain mathematical values to thisdata 34.Controller 12 selectively stores this “translated” data within memory 14. -
Step 56 followsstep 54 and, in thisstep 56, a “relevance analysis” is accomplished upon each of the identified objects 27 which are utilized withinstep 54. Particularly, in one non-limiting embodiment,assembly 10 determines whether each of theobjects 27, based upon their respective “translated” data and data values, are relevant or useful to thedriver 15 of thevehicle 11.Assembly 10 first “qualifies” each sensed and/or identifiedobject 27 as being “relevant” in the manner described below. - Substantially all data describing the road or highway on which the vehicle is traveling (e.g., the width, path of the road and condition of the road) is deemed to be “relevant” and
controller 12 retains this “road” data for further processing. In one non-limiting embodiment, this “road” data is recognized or identified bycontroller 12 based upon the identity of thosesensors 18 which provide this information. That is, certain of thesensors 18 and/or portions ofreceiver 24 are assigned to monitor only road conditions and attributes. Data originating from these sensors and/or portions ofreceiver 24, which are received bycontroller 12, are automatically determined to be within the “region of interest” 29 and are automatically “qualified” as being relevant bycontroller 12. - All
other data 34 is analyzed by assembly 10 (e.g., by controller 12) to determine whether it “matches” or “meets” various predetermined “relevance criteria” values, which are stored within a relevance database or matrix, selectively held and/or stored within memory 14. - In the preferred embodiment, the relevance criteria values represent and/or comprise data values or ranges of values respectively describing and/or defining object size and object location with respect to
vehicle 11. The “translated data”, for each identifiedobject 27, is first compared with a certain relevance criteria threshold in order to determine if it respectively matches or exceeds these relevance criteria threshold values (e.g., in one non-limiting example,controller 12 uses a “size threshold” to analyze the acquired data).Objects 27 having sensed size or positional values which match or exceed the respective and predetermined “minimal” relevance criteria threshold values are retained or stored within memory 14 for further processing. If theobject 27 does not have sensed values which meet at least one (e.g., in another non-limiting embodiment both or all threshold values must be met or exceeded) of these “minimal” relevance criteria threshold values, the data associated with the sensedobject 27 is discarded withinstep 58. If the sensed data associated with eachobject 27 does respectively meet the “minimal” threshold values, its respective attribute data values are further compared to a predetermined “upper threshold” relevance criteria values (e.g., again corresponding to object size and position). If the respectively sensedobject 27 has sensed attribute values which respectively match or exceed at least one of these upper values (e.g., relatively large objects such as a tree, a car, or a wall generally meet or exceed these relevance criteria values), theobject 27 is automatically “qualified” as being “relevant” by theassembly 10 and the sensed data relating to thatobject 27 is retained or stored within memory 14 for further processing.Objects 27 which have a respectively sensed attribute values which are respectively less than the “upper threshold” values, but are greater than “minimal threshold” values (e.g., “potentially relevant objects”) are further analyzed based upon their present and potentially future location with respect to thevehicle 11. - Particularly, the location, speed and path of travel of these potentially
relevant objects 27 are respectively compared to the current location, speed and path of travel of thevehicle 11. Using conventional statistical, mapping and prediction algorithms,controller 12 determines whether the projected path of thevehicle 11 and the projected and respective path of each of the potentiallyrelevant objects 27 will cause the respective and potentiallyrelevant objects 27 to either intersect or collide with thevehicle 11, or pass within a certain predetermined distance of the vehicle 11 (e.g., within 10 meters or some other programmable and/or modifiable distance). If thecontroller 12 determines that there will be a likelihood of a collision between a potentiallyrelevant object 27 and thevehicle 11, or that a potentiallyrelevant object 27 will pass within the certain predetermined and programmable distance of thevehicle 11, the respective potentiallyrelevant object 27 is “qualified” as being relevant byassembly 10 and the data relating to the “qualified”object 27 is retained for further processing. Additionally, in the preferred embodiment,assembly 10 will consider anobject 27 to be “qualified” if the direction or path of theobject 27 is erratic, uncertain, and/or unpredictable bycontroller 12. - It should be appreciated that pursuant to this “relevance criteria” analysis, substantially all relatively
large objects 27 will be “qualified” for display bysystem 10, and only thosesmaller objects 27 which meet a minimal threshold relevance criteria requirement and have a potential for collision or a potential for a “near” collision with thevehicle 11 will be “qualified” for display byassembly 10. As such,assembly 10 displays only those objects 27 (e.g., symbols relating to these objects 27) which are relatively “useful” or “relevant” to thevehicle 11 anddriver 15. It should further be understood that different types of “relevance criteria” data values or “filters” may be used byassembly 10 to determine whether aparticular object 27 is “relevant”. For example and without limitation,assembly 10 could determine relevance by the singular use of object size or shape, location or collision potential, or by the selective combination of one or more of these criteria. - In one non-limiting embodiment, substantially all of the sensed
data 34 respectively relating to each “qualified” or “relevant” objects 27 is used to match arespective object 27 with a representative icon, as illustrated bystep 60. Particularly, in thisstep 60,controller 12 compares the stored object attribute data values relating to the shape of each respectiverelevant object 27 with a database table or matrix containing predetermined values or ranges of values representing patterns, dimensions, and/or shapes which are associated with particular objects (e.g., trees, cars, rocks, lane markers, pedestrians, animals, construction barriers, bridges). Each range of values is assigned to and indicative of a particular type ofobject 27. - In the preferred embodiment of the invention,
controller 12 uses a standard “pattern recognition” algorithm which, in one non-limiting embodiment is a conventional algorithm, to compare the dimension and/or shape values of each “qualified”object 27 to those values contained within the database table. If the shape values of a “qualified”object 27 match or fall with the range assigned to a particular object type in the table, the “qualified”object 27 is assigned a display icon which is representative of that type of object (e.g., trees are assigned a “tree-shaped” icon, cars are assigned “car-shaped” icons). If the shape of the qualified orrelevant object 27 does not match any of the value ranges held within the table, an “unidentified” icon (e.g., a question mark or some other indicative symbol) is assigned to the object. - Once an icon is assigned to the
object 27,controller 12 applies display attributes to the icon which are representative of the object's sensed attributes/characteristics, withinstep 62. Specifically,controller 12, in one non-limiting embodiment, accesses the retained size, velocity, location, and trajectory data related to theobject 27 and dynamically modifies the icon accordingly, in a manner designed and effective to ensure the continued accuracy of the displayed icon or symbol. - For example and without limitation,
controller 12 uses a conventional scaling “program” and/or algorithm to selectively increase and/or decrease the size of the displayed icon in order to accurately represent the relative size and range of the object 27 (e.g.,controller 12 increases the size of the standard “vehicle” icon for relatively large vehicles, and decrease the size of the standard “vehicle” icon for relatively small automobiles). Thus, the actual size and range of the detectedobject 27 determines the size of the respective icon displayed byassembly 10. Furthermore, the range of theobject 27 determines the location of the icon's placement upondisplay 20 relative to the vehicle's representative icon (thevehicle 11 is assigned an icon which is disposed generally within the lower center of the display 20). In the preferred embodiment of the invention,controller 12 further assigns different attributes to the selectively displayed icons depending upon the sensed velocity of the identified objects 27. In one non-limiting example, objects 27 moving at a relatively fast velocity are displayed in the color of red,stationary objects 27 are displayed in the color of blue, and relatively slow movingobjects 27 are displayed in the color of yellow. As the speed of theobjects 27 change, the respective colors of the icons also change (e.g., anobject 27 which is initially stationary and then accelerates to move at a high speed has an icon which changes color from blue to red). In another embodiment of the invention, objects 27 having an erratic velocity and/or relatively high collision potential will be displayed as “flashing” or “blinking” icons, in order to effectively warn thedriver 15 or passengers ofvehicle 11 of a potential hazard. - Once all of the relevant object attributes are acquired, the respective icons are displayed upon
display 20. Particularly, the respective icons which are assigned to each of the “qualified” objects 27, along with their respective icon coordinates, are communicated to display 20.Display 20 displays the vehicle 11 (which is assigned an icon), the road upon which thevehicle 11 traverses, and all other “qualified” objects 27 within the “region of interest” 29. In the preferred embodiment of the invention, the assembly 10 (e.g. controller 12) dynamically updates the displayed object icons in “real time”, although other intervals of time by be utilized. - That is,
qualified objects 27 are identified and displayed in the foregoing manner and objects 27 which are no longer “relevant”, are not displayed. Each time that the “region of interest” 29 is altered or recalculated, a new signal describing this region is communicated to display 20 which increases or decreases the size of the icons in order to accommodate all of the relevant icons within the new/modified “region of interest” 29. For example, if the “region of interest” is increased, thecontroller 12 will decrease the size of the icons ondisplay 20 so that allrelevant objects 27 within the “region of interest” 29 will be displayed. In the preferred embodiment of the invention, the user may selectively “zoom-in” or enlarge certain areas of the “region of interest” 29, or expand or contract the “region of interest” 29 by entering associated command data intoinput device 28. - In the preferred embodiment of the invention, the “region of interest”29 may be displayed in one of several user selectable informational display formats or views. Particularly, a
driver 15 may enter the format of his or her choice by selective use of the data/command input device 28. In the preferred embodiment of the invention,driver 15 or another vehicle occupant may select from a top view format (See FIG. 5), which is a view from above thevehicle 15, a perspective view format (see FIG. 6), which a view from above and behind thevehicle 11, or an isometric view format (see FIG. 7), which is a view from above, behind and either to the left or to the right of thevehicle 11, depending on which side of the road thevehicle 11 is traveling (e.g., if thevehicle 11 travels in the right hand lane, such as in England, the isometric view is “taken” over the right shoulder of thedriver 15 toward the center of the road, alternatively, the view is from the left shoulder of the driver 15). Examples of each of these formats are illustrated in FIGS. 5-10. - Particularly, FIGS. 5 and 8 illustrate two different regions of interest displayed in the top view informational display format (e.g., the display which is shown in FIG. 5 has been dynamically adjusted in accordance with an updated “region of interest”29, thereby causing the display of FIG. 8 to be presented by assembly 10). In
screen 100 of FIG. 5,icon 102 represents thevehicle 11 equipped withsystem 10.Icons Icon 108 represents a tree,icon 110 represents an unidentified “qualified” or “relevant” object, andicons 112 represent lane markers.Screens screen 100 but displayed in respective perspective and isometric view display type formats. Icons representing thesame objects 27 are defined by the same reference numerals as delineated inscreen 100 of FIG. 5 with the exception that inscreen 200 the reference numerals are incremented by 100. Inscreen 300 of FIG. 7 the reference numerals are incremented by 200. - In
screen 400 of FIG. 8,icon 402 represents thevehicle 11 equipped withassembly 10,icon 404 represents a vehicle sensed within the “region of interest”,icon 406 represents a tree,icon 408 represents an unidentified “qualified” object, and icons 410 represent lane markers. Screens 500 (FIG. 9) and 600 (FIG. 10) illustrate the same “region of interest” 29 shown inscreen 400, but displayed in perspective and isometric view informational display type formats, respectively. Icons representing the same objects are defined by the same reference numerals as delineated inscreen 400 of FIG. 4 with the exception that inscreen 500 the reference numerals are incremented by 100, and inscreen 600 the reference numerals are incremented by 200. - It is understood that the various inventions are not limited to the exact construction illustrated and described above, but that these previously delineated inventions may be varied without departing from the scope of the inventions as described in the following claims.
Claims (20)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/370,144 US6429789B1 (en) | 1999-08-09 | 1999-08-09 | Vehicle information acquisition and display assembly |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/370,144 US6429789B1 (en) | 1999-08-09 | 1999-08-09 | Vehicle information acquisition and display assembly |
Publications (2)
Publication Number | Publication Date |
---|---|
US6429789B1 US6429789B1 (en) | 2002-08-06 |
US20020105439A1 true US20020105439A1 (en) | 2002-08-08 |
Family
ID=23458413
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/370,144 Expired - Lifetime US6429789B1 (en) | 1999-08-09 | 1999-08-09 | Vehicle information acquisition and display assembly |
Country Status (1)
Country | Link |
---|---|
US (1) | US6429789B1 (en) |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100123778A1 (en) * | 2008-11-14 | 2010-05-20 | Toyota Motor Engineering & Manufacturing North America, Inc. | Integrated Visual Display System |
WO2010055509A1 (en) * | 2008-11-13 | 2010-05-20 | Aser Rich Limited. | System and method for improved vehicle safety through enhanced situation awareness of a driver of a vehicle |
US20110106442A1 (en) * | 2009-10-30 | 2011-05-05 | Indian Institute Of Technology Bombay | Collision avoidance system and method |
US20130093889A1 (en) * | 2011-10-14 | 2013-04-18 | Continental Automotive Systems, Inc. | Smart rear-view display |
US20130107052A1 (en) * | 2010-03-10 | 2013-05-02 | Daimler Ag | Driver Assistance Device Having a Visual Representation of Detected Objects |
CN103140377A (en) * | 2010-08-12 | 2013-06-05 | 法雷奥开关和传感器有限责任公司 | Method for displaying images on a display device and driver assistance system |
USD793444S1 (en) * | 2015-11-11 | 2017-08-01 | Samsung Electronics Co., Ltd. | Display screen or portion thereof with icon |
US9783166B1 (en) * | 2016-06-07 | 2017-10-10 | International Business Machines Corporation | Windscreen clearing using surface monitoring |
DE102015202846B4 (en) | 2014-02-19 | 2020-06-25 | Magna Electronics, Inc. | Vehicle vision system with display |
Families Citing this family (70)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10361802B1 (en) | 1999-02-01 | 2019-07-23 | Blanding Hovenweep, Llc | Adaptive pattern recognition based control system and method |
US8352400B2 (en) | 1991-12-23 | 2013-01-08 | Hoffberg Steven M | Adaptive pattern recognition based controller apparatus and method and human-factored interface therefore |
US7209221B2 (en) * | 1994-05-23 | 2007-04-24 | Automotive Technologies International, Inc. | Method for obtaining and displaying information about objects in a vehicular blind spot |
JP3516856B2 (en) * | 1998-01-30 | 2004-04-05 | 富士重工業株式会社 | Outside monitoring device |
US7904187B2 (en) | 1999-02-01 | 2011-03-08 | Hoffberg Steven M | Internet appliance system and method |
US6917693B1 (en) * | 1999-12-20 | 2005-07-12 | Ford Global Technologies, Llc | Vehicle data acquisition and display assembly |
DE19963006A1 (en) * | 1999-12-24 | 2001-06-28 | Bosch Gmbh Robert | Method to detect and evaluate objects near vehicle, involves determining speed and distance of target object within virtual barrier or range gate, whose length and distance from vehicle can be varied |
US7852462B2 (en) * | 2000-05-08 | 2010-12-14 | Automotive Technologies International, Inc. | Vehicular component control methods based on blind spot monitoring |
AU2001259640A1 (en) * | 2000-05-08 | 2001-11-20 | Automotive Technologies International, Inc. | Vehicular blind spot identification and monitoring system |
US6819779B1 (en) * | 2000-11-22 | 2004-11-16 | Cognex Corporation | Lane detection system and apparatus |
US10298735B2 (en) | 2001-04-24 | 2019-05-21 | Northwater Intellectual Property Fund L.P. 2 | Method and apparatus for dynamic configuration of a multiprocessor health data system |
US7146260B2 (en) | 2001-04-24 | 2006-12-05 | Medius, Inc. | Method and apparatus for dynamic configuration of multiprocessor system |
US6615137B2 (en) * | 2001-06-26 | 2003-09-02 | Medius, Inc. | Method and apparatus for transferring information between vehicles |
US6727807B2 (en) * | 2001-12-14 | 2004-04-27 | Koninklijke Philips Electronics N.V. | Driver's aid using image processing |
US6985696B2 (en) * | 2001-12-20 | 2006-01-10 | Motorola, Inc. | Method and apparatus for facilitating wireless communications with a nonautomotive roaming object |
US7005974B2 (en) * | 2002-04-19 | 2006-02-28 | Donnelly Corporation | Vehicle imaging system |
US7178049B2 (en) | 2002-04-24 | 2007-02-13 | Medius, Inc. | Method for multi-tasking multiple Java virtual machines in a secure environment |
US6871145B2 (en) * | 2002-11-26 | 2005-03-22 | General Motors Corporation | Method and system for vehicle impact assessment using driver braking estimation |
US7450165B2 (en) * | 2003-05-02 | 2008-11-11 | Grandeye, Ltd. | Multiple-view processing in wide-angle video camera |
DE10326431A1 (en) * | 2003-06-10 | 2005-01-13 | Daimlerchrysler Ag | Device and method for determining the position of objects in the environment of a vehicle |
DE10341905A1 (en) * | 2003-09-11 | 2005-05-12 | Daimler Chrysler Ag | Method and device for determining a position of a motor vehicle on a road |
NO319425B1 (en) * | 2003-10-15 | 2005-08-08 | Telenor Asa | Animal alert system |
US7043342B1 (en) * | 2003-11-10 | 2006-05-09 | Thomas Gerret Dewees | Vehicle tracking driver assistance system |
WO2006014974A2 (en) * | 2004-07-26 | 2006-02-09 | Automotive Systems Laboratory, Inc. | Vulnerable road user protection system |
US7337650B1 (en) | 2004-11-09 | 2008-03-04 | Medius Inc. | System and method for aligning sensors on a vehicle |
US7493202B2 (en) * | 2004-11-12 | 2009-02-17 | Takata Corporation | Vehicle safety control system by image processing |
JP4773080B2 (en) * | 2004-12-17 | 2011-09-14 | 株式会社デンソー | Visibility improvement support device |
US7286062B2 (en) * | 2005-06-29 | 2007-10-23 | Honeywell International, Inc. | Perspective view conformal traffic targets display |
DE102005039103A1 (en) * | 2005-08-18 | 2007-03-01 | Robert Bosch Gmbh | Procedure for recording a traffic area |
US8519837B2 (en) * | 2005-09-08 | 2013-08-27 | Johnson Controls Gmbh | Driver assistance device for a vehicle and a method for visualizing the surroundings of a vehicle |
JP4813141B2 (en) * | 2005-10-05 | 2011-11-09 | 川崎重工業株式会社 | Information provision device |
JP4426535B2 (en) * | 2006-01-17 | 2010-03-03 | 本田技研工業株式会社 | Vehicle periphery monitoring device |
FR2896594A1 (en) * | 2006-01-24 | 2007-07-27 | Renault Sas | Movable and fixed elements e.g. pedestrian, perception method, involves introducing information related to elements of one series in perception system for fusion of images of environment established by vehicles |
DE102006036515A1 (en) * | 2006-08-04 | 2008-02-14 | Audi Ag | Motor vehicle with a lane detection system |
US7579942B2 (en) | 2006-10-09 | 2009-08-25 | Toyota Motor Engineering & Manufacturing North America, Inc. | Extra-vehicular threat predictor |
US7608825B2 (en) * | 2006-12-14 | 2009-10-27 | Sumitomo Electric Industries, Ltd. | Image pickup device, vision enhancement apparatus, night-vision apparatus, navigation support apparatus, and monitoring apparatus |
US7880621B2 (en) * | 2006-12-22 | 2011-02-01 | Toyota Motor Engineering & Manufacturing North America, Inc. | Distraction estimator |
US9285228B2 (en) * | 2007-06-14 | 2016-03-15 | Panasonic Automotive Systems Company Of America, Division Of Panasonic Corporation Of North America | Location based point of interest navigation system |
US7970178B2 (en) * | 2007-12-21 | 2011-06-28 | Caterpillar Inc. | Visibility range estimation method and system |
FR2926908A1 (en) * | 2008-01-30 | 2009-07-31 | Renault Sas | Motor vehicle i.e. car, driving assisting method, involves allocating quality score to each of pixels in each of corrected images, and selecting pixel having high quality in order to elaborate top view of environment of motor vehicle |
US20100063714A1 (en) * | 2008-09-05 | 2010-03-11 | International Business Machines Corporation | method for determining traffic conditions |
US8160755B2 (en) * | 2008-09-30 | 2012-04-17 | Honeywell International Inc. | Displaying air traffic symbology based on relative importance |
US8700255B2 (en) * | 2008-10-08 | 2014-04-15 | Trimble Navigation Limited | Devices, systems, and methods for monitoring driver and vehicle behavior |
FR2942342B1 (en) * | 2009-02-13 | 2011-03-18 | Peugeot Citroen Automobiles Sa | DEVICE FOR PROVIDING IMAGES REPRESENTATIVE OF THE FRONT AREA SITUATED IN FRONT OF A VEHICLE AND THE POSITION OF THE VEHICLE IN THE AREA SITUATED DOWNSTREAM OF THIS FRONT AREA, AND ASSOCIATED METHOD |
US9358924B1 (en) | 2009-05-08 | 2016-06-07 | Eagle Harbor Holdings, Llc | System and method for modeling advanced automotive safety systems |
US8417490B1 (en) | 2009-05-11 | 2013-04-09 | Eagle Harbor Holdings, Llc | System and method for the configuration of an automotive vehicle with modeled sensors |
JP5318720B2 (en) * | 2009-09-30 | 2013-10-16 | 富士通テン株式会社 | Electronic control unit |
US9230419B2 (en) | 2010-07-27 | 2016-01-05 | Rite-Hite Holding Corporation | Methods and apparatus to detect and warn proximate entities of interest |
US8477021B2 (en) | 2010-10-25 | 2013-07-02 | John Slack | Worksite proximity warning and collision avoidance system |
US8686873B2 (en) * | 2011-02-28 | 2014-04-01 | Toyota Motor Engineering & Manufacturing North America, Inc. | Two-way video and 3D transmission between vehicles and system placed on roadside |
US8791802B2 (en) * | 2011-09-09 | 2014-07-29 | Robert Bosch Gmbh | Driver assistance system for reducing blind-spot-detection false alerts |
DE102011084993A1 (en) * | 2011-10-21 | 2013-04-25 | Robert Bosch Gmbh | Transfer of data from image data-based map services to an assistance system |
US8886392B1 (en) | 2011-12-21 | 2014-11-11 | Intellectual Ventures Fund 79 Llc | Methods, devices, and mediums associated with managing vehicle maintenance activities |
TW201342320A (en) * | 2012-04-13 | 2013-10-16 | yan-hong Jiang | Display method for assisting driver in transportation vehicle |
US9298992B2 (en) * | 2014-02-20 | 2016-03-29 | Toyota Motor Engineering & Manufacturing North America, Inc. | Geographic feature-based localization with feature weighting |
EP2990991A1 (en) * | 2014-08-29 | 2016-03-02 | Honda Research Institute Europe GmbH | Method and system for using global scene context for adaptive prediction and corresponding program, and vehicle equipped with such system |
US9469248B2 (en) | 2014-10-10 | 2016-10-18 | Honda Motor Co., Ltd. | System and method for providing situational awareness in a vehicle |
USD758390S1 (en) | 2014-12-30 | 2016-06-07 | Toyota Jidosha Kabushiki Kaisha | Display screen with graphical user interface |
USD760247S1 (en) * | 2014-12-30 | 2016-06-28 | Toyota Jidosha Kabushiki Kaisha | Display screen with graphical user interface |
US9851500B2 (en) * | 2015-02-06 | 2017-12-26 | Corning Incorporated | Light-diffusing optical elements having cladding with scattering centers |
DE102015104940A1 (en) * | 2015-03-31 | 2016-10-06 | Valeo Schalter Und Sensoren Gmbh | A method for providing height information of an object in an environmental area of a motor vehicle at a communication interface, sensor device, processing device and motor vehicle |
US9815475B2 (en) * | 2015-11-24 | 2017-11-14 | Accenture Global Solutions Limited | Analytics platform for identifying a roadway anomaly |
KR101782362B1 (en) * | 2015-12-14 | 2017-10-13 | 현대자동차주식회사 | Vehicle, and control method for the same |
US11184531B2 (en) * | 2015-12-21 | 2021-11-23 | Robert Bosch Gmbh | Dynamic image blending for multiple-camera vehicle systems |
CN107323375B (en) * | 2017-06-27 | 2019-12-03 | 京东方科技集团股份有限公司 | In-vehicle display system, transit equipment and image display method |
KR102379504B1 (en) * | 2017-08-29 | 2022-03-28 | 삼성전자 주식회사 | Electronic device and method for analyzing collision |
US20190071014A1 (en) * | 2017-09-01 | 2019-03-07 | Honda Motor Co., Ltd | System for object indication on a vehicle display and method thereof |
FI128122B (en) * | 2018-08-29 | 2019-10-15 | Ponsse Oyj | Steering arrangement, and method of steering a forest machine |
CN111798698B (en) * | 2020-06-24 | 2022-04-08 | 中国第一汽车股份有限公司 | Method and device for determining front target vehicle and vehicle |
CN113459951A (en) * | 2021-08-12 | 2021-10-01 | 集度汽车有限公司 | Vehicle exterior environment display method and device, vehicle, equipment and storage medium |
Family Cites Families (22)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB1439943A (en) | 1973-04-30 | 1976-06-16 | Elliott Brothers London Ltd | Display devices |
US4182053A (en) | 1977-09-14 | 1980-01-08 | Systems Technology, Inc. | Display generator for simulating vehicle operation |
GB2213019B (en) | 1980-08-19 | 1989-10-25 | Elliott Brothers London Ltd | Head-up display systems |
US5845000A (en) | 1992-05-05 | 1998-12-01 | Automotive Technologies International, Inc. | Optical identification and monitoring system using pattern recognition for use with vehicles |
JPS6483424A (en) | 1987-09-25 | 1989-03-29 | Honda Motor Co Ltd | Indicator for vehicle |
CA2060406C (en) | 1991-04-22 | 1998-12-01 | Bruce Edward Hamilton | Helicopter virtual image display system incorporating structural outlines |
JP3031013B2 (en) | 1991-11-15 | 2000-04-10 | 日産自動車株式会社 | Visual information providing device |
US5396429A (en) | 1992-06-30 | 1995-03-07 | Hanchett; Byron L. | Traffic condition information system |
EP0614104A3 (en) | 1993-03-05 | 1995-12-20 | Hughes Aircraft Co | Virtual image display management system with head-up display. |
US5465142A (en) | 1993-04-30 | 1995-11-07 | Northrop Grumman Corporation | Obstacle avoidance system for helicopters and other aircraft |
DE4319904C2 (en) | 1993-06-16 | 2002-11-28 | Siemens Ag | Warning device for displaying information in a vehicle |
US5801943A (en) * | 1993-07-23 | 1998-09-01 | Condition Monitoring Systems | Traffic surveillance and simulation apparatus |
FR2715243B1 (en) | 1994-01-18 | 1996-02-09 | Renault | Information display device for road driver. |
US5666227A (en) | 1994-05-02 | 1997-09-09 | Ben-Ghiath; Yehoshua | Passive panoramic viewing systems |
US5414439A (en) | 1994-06-09 | 1995-05-09 | Delco Electronics Corporation | Head up display with night vision enhancement |
US5745870A (en) * | 1994-09-14 | 1998-04-28 | Mazda Motor Corporation | Traveling-path prediction apparatus and method for vehicles |
US5680312A (en) * | 1995-06-07 | 1997-10-21 | Zexel Corporation | Method and apparatus for selecting a destination in a vehicle navigation system |
US5825306A (en) * | 1995-08-25 | 1998-10-20 | Aisin Aw Co., Ltd. | Navigation system for vehicles |
US5907293A (en) * | 1996-05-30 | 1999-05-25 | Sun Microsystems, Inc. | System for displaying the characteristics, position, velocity and acceleration of nearby vehicles on a moving-map |
US5926112A (en) * | 1997-07-21 | 1999-07-20 | Hartzell; Chris | Emergency vehicle warning system |
US5978737A (en) * | 1997-10-16 | 1999-11-02 | Intel Corporation | Method and apparatus for hazard detection and distraction avoidance for a vehicle |
US5914652A (en) * | 1998-02-26 | 1999-06-22 | Adamo; Philip C. | Object sensing device for a vehicle |
-
1999
- 1999-08-09 US US09/370,144 patent/US6429789B1/en not_active Expired - Lifetime
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2010055509A1 (en) * | 2008-11-13 | 2010-05-20 | Aser Rich Limited. | System and method for improved vehicle safety through enhanced situation awareness of a driver of a vehicle |
US20100123778A1 (en) * | 2008-11-14 | 2010-05-20 | Toyota Motor Engineering & Manufacturing North America, Inc. | Integrated Visual Display System |
US8305444B2 (en) * | 2008-11-14 | 2012-11-06 | Toyota Motor Engineering & Manufacturing North America, Inc. | Integrated visual display system |
US20110106442A1 (en) * | 2009-10-30 | 2011-05-05 | Indian Institute Of Technology Bombay | Collision avoidance system and method |
US20130107052A1 (en) * | 2010-03-10 | 2013-05-02 | Daimler Ag | Driver Assistance Device Having a Visual Representation of Detected Objects |
CN103140377A (en) * | 2010-08-12 | 2013-06-05 | 法雷奥开关和传感器有限责任公司 | Method for displaying images on a display device and driver assistance system |
US20130093889A1 (en) * | 2011-10-14 | 2013-04-18 | Continental Automotive Systems, Inc. | Smart rear-view display |
DE102015202846B4 (en) | 2014-02-19 | 2020-06-25 | Magna Electronics, Inc. | Vehicle vision system with display |
USD793444S1 (en) * | 2015-11-11 | 2017-08-01 | Samsung Electronics Co., Ltd. | Display screen or portion thereof with icon |
US9783166B1 (en) * | 2016-06-07 | 2017-10-10 | International Business Machines Corporation | Windscreen clearing using surface monitoring |
Also Published As
Publication number | Publication date |
---|---|
US6429789B1 (en) | 2002-08-06 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6429789B1 (en) | Vehicle information acquisition and display assembly | |
EP3216667B1 (en) | Control system for vehicle | |
US10595176B1 (en) | Virtual lane lines for connected vehicles | |
JP7205154B2 (en) | Display device | |
US8847786B2 (en) | Driving scene transition prediction device and recommended driving operation display device for motor vehicle | |
US10099692B2 (en) | Control system for vehicle | |
US20070016372A1 (en) | Remote Perspective Vehicle Environment Observation System | |
US20220135062A1 (en) | Method for Operating a Driver Information System in an Ego-Vehicle and Driver Information System | |
US10754335B2 (en) | Automated driving system | |
US20210364305A1 (en) | Routing autonomous vehicles based on lane-level performance | |
KR101943809B1 (en) | Vehicle notification device | |
US20050278088A1 (en) | Method and apparatus for collision avoidance and enhanced visibility in vehicles | |
US10759334B2 (en) | System for exchanging information between vehicles and control method thereof | |
US20200333791A1 (en) | Driving assistance system | |
JP4775131B2 (en) | Vehicle driving assistance device | |
US20220161657A1 (en) | Method for Operating a Driver Information System in an Ego-Vehicle and Driver Information System | |
CN113710530A (en) | Method for operating a driver information system in an autonomous vehicle and driver information system | |
KR102330614B1 (en) | Traffic signal control system and method thereof | |
US20220135063A1 (en) | Method for Operating a Driver Information System in an Ego-Vehicle and Driver Information System | |
US7286930B2 (en) | Ghost following | |
US20210381179A1 (en) | A driverless impact attenuating traffic management vehicle | |
CN114126940A (en) | Electronic control device | |
CN111469763A (en) | Parking assist system utilizing parking space occupancy readings | |
CN110053616A (en) | Vehicle drive assist system and method | |
JP2019027996A (en) | Display method for vehicle and display device for vehicle |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: FORD GLOBAL TECHNOLOGIES, INC., MICHIGAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:FORD MOTOR COMPANY;REEL/FRAME:010163/0312 Effective date: 19990803 Owner name: FORD MOTOR COMPANY, MICHIGAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KIRIDENA, VIJITHA SENAKA;SMITH, GREGORY HUGH;REEL/FRAME:010163/0434 Effective date: 19990803 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
FPAY | Fee payment |
Year of fee payment: 8 |
|
FPAY | Fee payment |
Year of fee payment: 12 |