US6515597B1 - Vicinity display for car - Google Patents

Vicinity display for car Download PDF

Info

Publication number
US6515597B1
US6515597B1 US09/937,515 US93751501A US6515597B1 US 6515597 B1 US6515597 B1 US 6515597B1 US 93751501 A US93751501 A US 93751501A US 6515597 B1 US6515597 B1 US 6515597B1
Authority
US
United States
Prior art keywords
vehicle
unit
picture data
picture
positional information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
US09/937,515
Inventor
Jyoji Wada
Masami Takahashi
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Panasonic Holdings Corp
Original Assignee
Matsushita Electric Industrial Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Matsushita Electric Industrial Co Ltd filed Critical Matsushita Electric Industrial Co Ltd
Assigned to MATSUSHITA ELECTRIC INDUSTRIAL CO., LTD. reassignment MATSUSHITA ELECTRIC INDUSTRIAL CO., LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: TAKAHASHI, MASAMI, WADA, JYOJI
Application granted granted Critical
Publication of US6515597B1 publication Critical patent/US6515597B1/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Arrangement of adaptations of instruments
    • B60K35/28
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • B60K2360/179
    • B60K2360/21

Definitions

  • the present invention is related to a vehicle peripheral-area display apparatus for picking-up an image of a peripheral area of a vehicle by operating a camera mounted on this vehicle, and for displaying the image of this picked up peripheral area of the vehicle on a monitor display unit.
  • a vehicle peripheral-area display apparatus while a plurality of cameras are mounted on a vehicle in order to pick up an image of a peripheral area of this vehicle, image data having different view angles and acquired by these plural cameras are combined with each other, so that the peripheral area of the vehicle is displayed on a monitor display unit contained in the vehicle.
  • peripheral-area of the vehicle can be monitor-displayed in real time, for instance, considering a mounting position of such a camera used to pick up an image of a road surface of a lower portion of a vehicle body of this vehicle, this road surface of the lower portion of the vehicle body could not be monitor-displayed. Furthermore, there is another problem that the peripheral portion of the vehicle which has been picked up in the past could not be monitor-displayed.
  • the present invention has been made to solve the above-described problems, and therefore, has an object to provide a vehicle peripheral-area display apparatus capable of monitor-displaying not only a road surface of a lower portion of a vehicle body of a vehicle, but also a peripheral-area of the vehicle, which has been picked up in the past, even when such plural cameras used to pick up all of peripheral-areas of this vehicle are not mounted.
  • a vehicle peripheral-area display apparatus of the present invention is featured by comprising: an image pick-up means for picking up images of a peripheral area of a vehicle; a positional information detecting means for detecting the own vehicle position of the vehicle as positional information; a data storage means for storing thereinto both picture data as to the peripheral area of the vehicle, which is picked up by the pick-up means, and also the positional information of the picked up vehicle; a picture composite means for reading out picture data corresponding to the positional information detected by the positional information detecting means from the data storage unit, and for combining the read picture data with such picture data indicative of a shape of the vehicle; and a display control means for causing the picture data combined in the picture composite means to be displayed on a display means.
  • the vehicle peripheral-area display apparatus of the present invention is featured by comprising: a picture data comparing means for comparing present picture data as to the peripheral area of the vehicle picked up by the image pick-up means with the picture data which is stored in the data storage unit and corresponds to the positional information of the picked up vehicle; and in that the positional information detecting means corrects the detected present positional information based upon the comparison result of the picture data comparing means.
  • the present picture data as to the picked up peripheral area of the vehicle is compared with the picture data which is stored in the data storage means and corresponds to the positional information of the picked up images of vehicle, and then, the present positional information is corrected based upon this comparison result, so that the precision of this present positional information of the vehicle can be increased.
  • the vehicle peripheral-area display apparatus of the present invention is featured by that the positional information detecting means is comprised of: a steering, amount detecting means for detecting a steering amount equivalent to a steering angle of the vehicle; a travel distance detecting means for detecting a travel amount equivalent to a travel distance of the vehicle; and an integration processing means for performing an integration process operation with respect to both the steering amount detected by the steering amount detecting means and the travel amount detected by the travel distance detecting means, whereby the own vehicle position of the vehicle is calculated as positional information.
  • the positional information detecting means is comprised of: a steering, amount detecting means for detecting a steering amount equivalent to a steering angle of the vehicle; a travel distance detecting means for detecting a travel amount equivalent to a travel distance of the vehicle; and an integration processing means for performing an integration process operation with respect to both the steering amount detected by the steering amount detecting means and the travel amount detected by the travel distance detecting means, whereby the own vehicle position of the vehicle is calculated as positional information.
  • the own vehicle position of the vehicle can be simply calculated as the positional information.
  • the vehicle peripheral-area display apparatus of the present invention is featured by comprised of: a picture data comparing means for comparing present picture data as to the peripheral area of the vehicle picked up by the image pick-up means with the picture data which is stored in the data storage means and corresponds to the positional information of the picked up images of vehicle; and a correction coefficient calculating means for calculating a correction coefficient for the integration process operation executed by the integration processing unit so as to correct the present positional information based upon an error of a portion where the present picture data is overlapped with the past picture data by the picture data comparing means.
  • the correction coefficient of the integration process operation is calculated based upon the error contained in the portion where the present picture data is overlapped with the past picture data.
  • the calculation precision of the positional information performed by the integration processing means 21 can be largely improved.
  • the vehicle peripheral-area display apparatus of the present invention is featured by that the picture composite means produces three-dimensional picture data based upon both the picture data corresponding to the present position information and picture data corresponding to such positional information located adjacent to the present positional information, and also combines the three-dimensional picture data with the picture data of the vehicle.
  • the picture composite means produces the three-dimensional picture data based upon the present positional information and also a plurality of picture data corresponding to the positional information located adjacent to this present positional information
  • this three-dimensional picture data is combined with the picture data of the own vehicle, so that the three-dimensional picture can be monitor-displayed.
  • the vehicle peripheral-area display apparatus of the present invention is featured by that the vehicle peripheral-area display apparatus is comprised of: a picture map producing means for producing a picture map based upon a plurality of positional information and also past picture data corresponding to the respective positional information, which are stored in the data storage means; and the display control means displays the picture map produced by the picture map producing means on the display means.
  • the vehicle peripheral-area display apparatus of the present invention is featured by that the image pick-up means is comprised of: a backward image pick-up means for picking up a backward scene of the vehicle; a forward image pick-up means for picking up a forward scene of the vehicle; a travel direction detecting means for detecting a travel direction of the vehicle; and a control means for executing the image pick-up operation only by the forward image pick-up means when the travel direction detecting means detects a forward travel of the vehicle, and also for executing the image pick-up operation only by the backward image pick-up means when the travel direction detecting means detects a backward travel of the vehicle.
  • the control means executes the image pick-up operation only by the forward image pick-up means when the traveling direction detecting means detects the forward travel of the vehicle whereas the control means performs the image pick-up operation only by the backward image pick-up means when traveling direction detecting means detects the backward travel of the vehicle.
  • FIG. 1 is a block diagram for shows a schematic arrangement side a vehicle peripheral-area display apparatus according to an embodiment of the present invention.
  • FIG. 2 is an explanatory diagram for representing a use condition of a vehicle which employs the vehicle peripheral-area display apparatus according to this embodiment.
  • FIG. 3 is a flow chart for describing a process operation of a CPU related to a peripheral-area display apparatus according to this embodiment.
  • FIG. 4 is a flow chart for describing a process operation of the CPU in such a case that a plane display is converted into a three-dimensional display in a peripheral-area display process operation according to this embodiment.
  • reference numeral 1 shows a vehicle peripheral-area display apparatus
  • reference numeral 11 represents a camera (image pick-up means)
  • reference numeral 12 indicates a vehicle sensor (positional information detecting means);
  • reference numeral 12 a denotes a steering sensor (steering amount detecting means);
  • reference numeral 12 b is a wheel rotation sensor (drive distance detecting means);
  • reference numeral 15 shows a memory (data storage means);
  • reference numeral 15 a indicates a picture memory area (data storage means);
  • reference numeral 16 represents a monitor display unit (display means);
  • reference numeral 20 is a CPU;
  • reference numeral 21 represents an integration processing unit (integration processing means);
  • reference numeral 24 represents a memory control unit (picture composite means);
  • reference numeral 25 denotes a picture composite process unit (picture composite means);
  • reference numeral 26 indicates a display control unit (display control means);
  • reference numeral 27 represents a picture data comparing process unit (picture data comparing means);
  • FIG. 1 is a block diagram showing a schematic arrangement inside a vehicle peripheral-area display apparatus according to an embodiment of the present invention.
  • FIG. 2 is an explanatory diagram for representing a schematic structure of: a vehicle which employs the vehicle peripheral-area display apparatus according to this embodiment.
  • the vehicle peripheral-area display apparatus 1 shown in FIG. 1 is arranged by employing a camera 11 corresponding to an image pick-up means for picking up images of a peripheral area of a vehicle 2 , a vehicle sensor 12 used to detect the own vehicle position of the vehicle 2 as positional information, a camera picture buffer 13 for buffering picture data (video data) of the peripheral area of the vehicle 2 picked up by the camera 11 , an A/D converter 14 for converting the picture data buffered in this camera picture buffer 13 into digitally converted picture data, and a memory 15 corresponding to a data storage means for sequentially storing thereinto the digitally-converted picture data, and also for storing thereinto various data.
  • a camera 11 corresponding to an image pick-up means for picking up images of a peripheral area of a vehicle 2
  • a vehicle sensor 12 used to detect the own vehicle position of the vehicle 2 as positional information
  • a camera picture buffer 13 for buffering picture data (video data) of the peripheral area of the vehicle 2 picked up by the camera 11
  • the vehicle peripheral-area display apparatus 1 is further arranged by employing a monitor display unit 16 corresponding to a display means for displaying thereon various picture data, a warning display unit 17 for displaying a warning notice and the like, and a CPU 20 for controlling an entire arrangement of the vehicle peripheral-area display apparatus 1 via a CPU bus 18 .
  • the vehicle sensor 12 includes a steering sensor 12 a and a wheel rotation sensor 12 b .
  • the steering sensor 12 a corresponds to a steering amount detecting means for detecting a steering amount which is equivalent to a steering angle of the vehicle 2 .
  • the wheel rotation sensor 12 b corresponds to a drive distance detecting means for detecting a drive amount (travel amount) which is equivalent to a drive distance of the vehicle 2 .
  • the CPU 20 includes an integration processing unit 21 , an integration buffer 22 , a picture arranging process unit 23 , a memory control unit 24 , a picture composite process unit 25 , a display control unit 26 , a picture data comparing process unit 17 , and also a correction coefficient calculating unit 28 .
  • the integration processing unit 21 corresponds to an integration processing means for executing an integration process operation with respect to both the steering amount detected by the steering sensor 12 a and the drive amount detected by the wheel rotation sensor 12 b so as to calculate the own vehicle position of the vehicle 2 as positional information.
  • the integration buffer buffers the calculated positional information.
  • the picture arranging process unit 22 executes a changing process operation of a camera view angle with respect to the picture data stored in the memory 15 .
  • the memory control unit 24 corresponds to a picture composite means for storing/controlling the picture data into the memory 15 in correspondence with the positional information acquired by picking up this picture data.
  • the picture composite process unit 25 corresponds to a picture composite means in which while the past picture data corresponding to the present positional information is read out from the memory 15 under control of the memory control unit 24 , this picture composite means combines vehicle shape data “X” as shown in FIG. 2 ( b ) with this past picture data.
  • the display control unit 26 corresponds to a display control means for displaying the picture data combined by this picture composite process unit 25 on the monitor display unit 16 .
  • the picture data comparing process unit 27 corresponds to a picture data comparing means for comparing present picture data of the peripheral area of the vehicle 2 picked up by the camera 11 with past picture data which corresponds to present positional information as to the picked up images of peripheral area of the vehicle 2 .
  • the correction coefficient calculating unit 28 corresponds to a correction coefficient calculating means for calculating a correction coefficient of the integration process by the integration processing unit 21 in order that the present positional information should be corrected based upon such an error of an overlapped portion between the present picture data and the past picture data in this picture data comparing process unit 27 .
  • this CPU 20 includes a picture three-dimensionally processing unit 29 , and a picture map producing unit 30 c .
  • This picture three-dimensionally processing unit 29 corresponds to such a picture composite means which produces three-dimensional picture data in the following manner. That is, a positional change of the same target point on the display screen, which is related to the same image pick-up target, is obtained from two sets of picture data with respect to positional information located adjacent to each other, and then, a three-dimensional coordinate value of the target point is obtained from a travel distance of the vehicle 2 and from the positional change appeared on the display screen.
  • the picture map producing unit 30 corresponds to a picture map producing means for producing a picture map based upon a plurality of positional information, and the past picture data corresponding to the respective positional information stored in the memory 15 .
  • the memory 15 includes a picture memory area 15 a , a positional information memory area 15 b , an own vehicle shape data memory area 15 c , and an initial setting value memory area 15 d .
  • the picture memory area 15 a sequentially stores thereinto the picture data picked up by the camera 11 .
  • the positional information memory area 15 b stores thereinto the positional information of the vehicle 2 in correspondence with the picture data when this picture data: is picked up.
  • the own vehicle shape data memory area 15 c stores thereinto own vehicle shape data “X” of the vehicle 2 , which is combined by the picture composite process unit 25 .
  • the initial setting value memory area 15 d stores thereinto initial setting values as to a setting position of the camera 11 , a view angle of the camera 11 , a distortion specification of the camera 11 , and display range specifications of the monitor display unit 16 , which may depend upon an automatic/manual drive mode and a vehicle speed direction.
  • FIG. 2 is an explanatory diagram for explaining an outer-view construction of the vehicle 2 which employs the vehicle peripheral-area display apparatus 1 according to this embodiment.
  • the monitor display unit 16 is equipped within a driver's seat of the vehicle 2 in order that a picture picked up by the camera 11 may be displayed on the monitor display unit 26 .
  • FIG. 3 is a flow chart for explaining process operations of the CPU 20 related to a peripheral-area display process operation executed by the vehicle peripheral-area display apparatus 1 according to this embodiment.
  • peripheral-area display process operation defined in FIG. 3 explains the following process operation. That is, normally, both picture data of a peripheral-area of the vehicle 2 , which is picked up by the camera 11 , and positional information of the vehicle 2 , which corresponds to a image pick-up position of this peripheral area of the vehicle 2 , are stored into the memory 11 in correspondence with these picture data and positional information. Furthermore, when the CPU judges such a fact that past picture data corresponding to the present positional information is stored into the memory 15 , the picture data “X” of the own vehicle shape is combined with this past picture data, and thus, this composite picture data is displayed on the monitor display unit.
  • the CPU 20 indicated in FIG. 3 executes an initial setting operation (step S 11 ). That is, this CPU 20 reads out the initial setting value which has been stored in the initial setting value memory area 15 d , for instance, since the display range specification of the monitor display unit 16 is set, the CPU 20 may set the display range of the monitor display unit 16 . Alternatively, for example, since the CPU 20 sets the camera angle, the distortion specification, the camera setting position, and the camera setting direction, the camera specification may be set.
  • the CPU 20 judges as to whether or not the present mode corresponds to such a display mode in which the peripheral area of the vehicle 2 is monitored/displayed on the monitor display unit 16 (step S 12 ). It should be noted that the mode such as the display mode may be set by manipulating an operation key prepared on the monitor display unit 16 .
  • the CPU 20 judges that the present mode is not equal to the display mode, the CPU 20 judges that the present mode corresponds to a picture acquisition mode in which a picture of a peripheral area of the vehicle 2 is merely acquired without performing the monitor display operation.
  • the CPU 20 acquires picture data which are sequentially picked up by the camera 11 , and buffers these acquired picture data into the camera picture buffer 13 (step S 13 ).
  • the integration processing unit 21 of the CPU 20 performs the integration processing operation with respect to both a steering amount sensed by the steering sensor 12 a and a drive amount sensed by the wheel rotation sensor 12 in order to detect a vehicle position picked up by this camera 11 .
  • the integration processing unit 21 of the CPU 20 detects present positional information of the vehicle (step S 14 ).
  • the memory control unit 24 of the CPU 20 judges as to whether or not the past picture data which corresponds to the present positional information of the detected vehicle is stored into the picture memory area 15 a (step S 15 ).
  • the memory control unit 24 judges such a fact that the picture data corresponding to the present positional information is stored in the picture memory area 15 a , the memory control unit 24 digitally converts the picture data by the A/D converter 14 , which has been buffered into the camera picture buffer 13 at the step S 13 , and then stores this digitally-converted picture data into the picture memory area 15 a . Also, the memory control unit 24 stores the positional information of the vehicle detected at the step S 14 into the vehicle positional information memory area 15 b in correspondence with this stored picture data (step S 16 ).
  • the picture data comparing process unit 27 compares the present picture data corresponding to this vehicle positional information with the past picture data, so that this picture data comparing process unit 27 detects an error in such a portion where the present picture data is overlapped with the past picture data (step S 17 ).
  • the correction coefficient calculating unit 28 calculates a correction efficient for the integration process operation by the integration processing unit 21 in order that the present positional information is corrected based upon the error detected by the picture data comparing process unit 27 (step S 18 ). Then, the correction coefficient calculating unit 28 sets this calculated correction coefficient to the integration processing unit 21 (step S 19 ) The process operation is advanced to a process step “M 1 ” shown in this drawing so as to furthermore acquire pictures.
  • this memory control unit 24 stores the picture data acquired at the step S 13 into the picture memory area 15 a , and also stores the present positional information of the vehicle detected at the step S 14 into the vehicle positional information memory area 15 b (step S 20 ). Then, the process operation is advanced to the process step “M 1 ” shown in this drawing in order to furthermore acquire pictures.
  • the CPU 20 judges that the present mode corresponds to the display mode at the step S 12 , the CPU 20 buffers the picture data picked up by the camera 11 into the camera picture buffer 13 (step S 21 ), and furthermore, makes the integration processing unit 21 to detect present positional information of the vehicle 2 (step S 22 ).
  • the memory control unit 24 judges as to whether or not such past picture data corresponding to the present vehicle positional information is stored in the picture memory area 15 a (step S 23 ).
  • the memory control unit 24 judges such a fact that the past picture data corresponding to the present vehicle position information is stored in the picture memory area 15 a , the memory control unit 24 stores the picture data acquired at the step S 20 into the picture memory area 15 a , and stores the present positional information detected at the step S 21 into the vehicle positional information memory area 15 b in correspondence with this picture data (step S 24 ).
  • the picture data comparing process unit 27 compares the present picture data corresponding to this vehicle positional information with the past picture data, so that this picture data comparing process unit 27 detects an error in such a portion where the present picture data is overlapped with the past picture data (step S 25 ).
  • the correction coefficient calculating unit 28 calculates a correction efficient for the integration process operation by the integration processing unit 21 in order that the present positional information is corrected based upon the error detected by the picture data comparing process unit 27 (step S 26 ). Then, the correction coefficient calculating unit 28 sets this calculated correction coefficient to the integration processing unit 21 (step S 27 ).
  • the picture composite process unit 25 produces a composite picture data from the past picture data and the present picture data. Then, the picture composite process unit 25 produces a picture data of a peripheral area of the vehicle 2 to be displayed on the monitor display unit 16 by selecting a present picture date in the range where the past picture data is overlapped with the present picture data. (step S 28 ).
  • the picture composite process unit 25 reads the own vehicle shape data “X” under storage into the own vehicle shape data memory area 15 c , and then, combines this own vehicle shape data “X” with the picture data which is produced at the previous step S 28 (step S 29 ).
  • the display control unit 26 displays the picture data combined at the step S 29 on the monitor display unit 26 (step S 30 ). Then, the process operation is advanced to a process step “M 2 ” in this drawing so as to further acquire a picture.
  • the memory control unit 24 judges such a fact that the past picture data corresponding to the present vehicle position information is not stored in the picture memory area 15 a , the memory control unit 24 stores the picture data acquired at the step S 21 into the picture memory area 15 a , and stores the present positional information detected at the step S 22 into the vehicle positional information memory area 15 b in correspondence with this picture data (step S 31 ).
  • the picture composite process unit 25 reads the own vehicle shape data “X” under storage into the own vehicle shape data memory area 15 c , and then, combines this own vehicle shape data “X” with the picture data which corresponds to the present vehicle positional information (step S 32 ).
  • the display control unit 26 monitor-displays the picture data combined at the step S 32 on the monitor display unit 16 (step S 33 ). Then, the process operation is advanced to a process step “M 2 ” in this drawing so as to further acquire a picture.
  • FIG. 4 is a flow chart for describing a process operation executed by the CPU 20 related to a three-dimensional representation.
  • This three-dimensional display process operation may be initiated by entering, for instance, a three-dimensional display initiation key prepared in the operation key of the monitor display unit 16 .
  • the picture three-dimensionally processing unit 29 produces three-dimensional picture data in the following manner (step S 41 ). That is, this picture three-dimensionally processing unit 29 compares the picture data corresponding to the present positional information being presently stored in the picture memory area 15 a with such a picture data corresponding to positional information which is located adjacent to this present positional information so as to acquire a positional change of the same target point on the display screen from these two sets of picture data. The same target point is related to the same imaging target subject. Then, the three-dimensionally processing unit 29 produces three-dimensional picture data by acquiring a three-dimensional coordinate value of the target point based upon both the travel distance (drive distance) of the vehicle 2 and the positional change on the display screen.
  • the picture three-dimensionally processing unit 29 calculates an interval between this imaging target article and the vehicle (step S 42 ).
  • the picture composite process unit 25 combines the own vehicle shape data “X” read out from the own vehicle shape data memory area 15 c with the produced three-dimensional picture data based upon the interval between the imaging target article and the vehicle, which is calculated in the picture three-dimensionally processing unit 29 (step S 43 ).
  • the picture composite process unit 25 displays this combined three-dimensional picture data on the monitor display unit 16 (step S 44 ), and the process operation is advanced to the process step “M 2 ” indicated in FIG. 3 .
  • the picture three-dimensionally processing unit 29 produces three-dimensional picture data in the following manner (step S 45 ). That is, this picture three-dimensionally processing unit 29 compares the picture data corresponding to the present positional information being presently stored in the picture memory area 15 a with a picture data corresponding to positional information which is located adjacent to this present positional information so as to acquire a positional change of the same target point on the display screen from these two sets of picture data. The same target point is related to the same imaging target subject. Then, the three-dimensionally processing unit 29 produces three-dimensional picture data by acquiring a three-dimensional coordinate value of the target point based upon both the travel distance (drive distance) of the vehicle 2 and the positional change on the display screen.
  • the picture three-dimensionally processing unit 29 calculates an interval between this target article and the vehicle (step S 46 ).
  • the picture composite process unit 25 combines the own vehicle shape data “X” read out from the own vehicle shape data memory area 15 c with the produced three-dimensional picture data based upon the interval between the imaging target article and the vehicle, which is calculated in the picture three-dimensionally processing unit 29 (step S 47 ).
  • the picture composite process unit 25 displays this combined three-dimensional picture data on the monitor display unit 16 (step S 48 ), and the process operation is advanced to the process step “M 2 ” indicated in FIG. 3 .
  • the interval between the imaging target article and the vehicle is calculated at the steps S 42 and S 46 . Furthermore, since such an interval is calculated, when the CPU 20 thereafter senses such a fact that the vehicle 2 is approached to this imaging target article, this CPU 20 may notify via the warning display unit 17 to the user, such a warning notice that the vehicle most probably collides with the imaging target subject. Also, this CPU 20 may notify a steering guide for avoiding this collision via the warning display unit 17 to the user as to a collision-avoiding-measure indication.
  • the below-mentioned picture map may be formed.
  • the picture map producing unit 30 of the CPU 20 produces a picture map based upon the positional information stored in the picture memory area 15 a , and also the past picture data which are stored in the vehicle positional information memory area 15 b , and correspond to the respective positional information.
  • the display control unit 26 displays the picture map produced by the picture map producing unit 30 on the monitor display unit 16 .
  • the picture data as to the peripheral area of the vehicle 2 and also the positional information of the vehicle acquired when these pictures are picked up are sequentially stored into both the picture memory area 15 a and the vehicle positional information memory area 15 b .
  • the past picture data corresponding to the present positional information of the vehicle 2 is read out from the picture memory area 15 a .
  • the own vehicle shape data “X” is combined with this past picture data, and this combined picture data is displayed on the monitor display unit 16 .
  • the correction coefficient of the integration process operation is calculated based upon the error contained in the portion where the present picture data is overlapped with the past picture data.
  • the calculation precision of the positional information performed by the integration processing unit 21 can be largely improved.
  • this three-dimensional picture data is produced based upon the present positional information and also a plurality of picture data corresponding to the positional information located adjacent to this present positional information, this three-dimensional picture data is combined with the own vehicle shape data “X”, so that the three-dimensional picture can be displayed on the monitor.
  • this picture map is displayed on the monitor display unit 16 .
  • a real picture which could not be conventionally obtained may be utilized as the map, so that utilization of the user can be greatly improved.
  • the vehicle peripheral-area display apparatus is equipped with a backward image pick-up means, a forward image pick-up means, and further, the CPU 20 is equipped with a traveling direction detecting means, and also a control means, then this vehicle peripheral-area display apparatus may acquire larger numbers of picture data without the switching operation by the user as to the backward image pick-up means and the forward image pick-up means, resulting in a higher effect.
  • This backward image pick-up means functions as a camera for picking up pictures of the backward range of the vehicle 2 .
  • the forward image pick-up means functions as a camera for picking up pictures of the forward range of the vehicle 2 .
  • the traveling direction detecting means detects the traveling direction of the vehicle 2 by detecting, for example, a gear range of the vehicle 2 .
  • the control means executes the image pick-up operation only by the forward image pick-up means when the traveling direction detecting means detects the forward travel of the vehicle 2 , whereas the control means performs the image pick-up operation 5 only by the back ward image pick-up means when traveling direction detecting means detects the backward travel of the vehicle 2 .
  • the peripheral areas of the traveling vehicle 2 are stored as the picture data into the picture memory area 15 a .
  • the contents of this picture memory area 15 a may be reproduced on the monitor display unit 16 in response to a predetermined operation.
  • this vehicle peripheral-area display apparatus is employed in a vehicle used in an automobile training school, since a trainee observes a picture displayed on the monitor display unit 16 , this trainee can objectively recognize own driving conditions.

Abstract

0 A vehicle peripheral-area display apparatus comprising: a camera (11) for picking up images of a peripheral area of a vehicle (2); an integration processing unit (21) for detecting the vehicle's own position as positional information via a vehicle sensor (12); a memory (15) for storing present picture data as to the peripheral area of the vehicle picked up by the camera (11), and also for storing positional information as to the picked up images of peripheral area of the vehicle; a picture composite unit (25) for reading past picture data corresponding to the positional information from the memory (15) by way of a memory control unit (24), and for combining own vehicle shape data “x” with this past picture data; and a display control unit (26) for displaying the picture data combined by this picture composite process unit (25) on a monitor display unit (16). As a result, this vehicle peripheral-area display apparatus of the present invention can display not only the road surface of the lower portion of the vehicle body of this vehicle, but also the past peripheral-area.

Description

TECHNICAL FIELD
The present invention is related to a vehicle peripheral-area display apparatus for picking-up an image of a peripheral area of a vehicle by operating a camera mounted on this vehicle, and for displaying the image of this picked up peripheral area of the vehicle on a monitor display unit.
BACKGROUND ART
Conventionally, as such a vehicle peripheral-area display apparatus, while a plurality of cameras are mounted on a vehicle in order to pick up an image of a peripheral area of this vehicle, image data having different view angles and acquired by these plural cameras are combined with each other, so that the peripheral area of the vehicle is displayed on a monitor display unit contained in the vehicle.
However, in accordance with the above-explained conventional vehicle peripheral-area display apparatus, there is a problem in order to monitor-display the peripheral-area of the vehicle. That is, a plurality of cameras used to pick up images regarding all of the peripheral areas of the vehicle should be mounted.
Also, in accordance with the above-described conventional vehicle peripheral-area display apparatus, although the peripheral-area of the vehicle can be monitor-displayed in real time, for instance, considering a mounting position of such a camera used to pick up an image of a road surface of a lower portion of a vehicle body of this vehicle, this road surface of the lower portion of the vehicle body could not be monitor-displayed. Furthermore, there is another problem that the peripheral portion of the vehicle which has been picked up in the past could not be monitor-displayed.
The present invention has been made to solve the above-described problems, and therefore, has an object to provide a vehicle peripheral-area display apparatus capable of monitor-displaying not only a road surface of a lower portion of a vehicle body of a vehicle, but also a peripheral-area of the vehicle, which has been picked up in the past, even when such plural cameras used to pick up all of peripheral-areas of this vehicle are not mounted.
DISCLOSURE OF THE INVENTION
To achieve the above-described object, a vehicle peripheral-area display apparatus of the present invention is featured by comprising: an image pick-up means for picking up images of a peripheral area of a vehicle; a positional information detecting means for detecting the own vehicle position of the vehicle as positional information; a data storage means for storing thereinto both picture data as to the peripheral area of the vehicle, which is picked up by the pick-up means, and also the positional information of the picked up vehicle; a picture composite means for reading out picture data corresponding to the positional information detected by the positional information detecting means from the data storage unit, and for combining the read picture data with such picture data indicative of a shape of the vehicle; and a display control means for causing the picture data combined in the picture composite means to be displayed on a display means.
As a consequence, in accordance with the vehicle peripheral-area display apparatus of the present invention with employment of the above-described structure, while both the picture data as to the picked up peripheral area of the vehicle, and also the positional information of the vehicle acquired during this pick-up operation are sequentially stored into the data storage means, the picture data corresponding to the positional information detected by the positional information detecting means is read out from the data storage means, and then, this read picture data is combined with such a picture data indicative of the shape of the vehicle. This combined picture data is displayed on the display means. As a consequence, even when a plurality of cameras which may pick up all of the peripheral areas of the vehicle are not mounted on the vehicle, not only the road surface of the lower portion of the vehicle body of the vehicle can be monitor-displayed, but also the past pictures of the peripheral area of the vehicle can be monitor-displayed.
The vehicle peripheral-area display apparatus of the present invention is featured by comprising: a picture data comparing means for comparing present picture data as to the peripheral area of the vehicle picked up by the image pick-up means with the picture data which is stored in the data storage unit and corresponds to the positional information of the picked up vehicle; and in that the positional information detecting means corrects the detected present positional information based upon the comparison result of the picture data comparing means.
As a consequence, in accordance with the vehicle peripheral-area display apparatus, the present picture data as to the picked up peripheral area of the vehicle is compared with the picture data which is stored in the data storage means and corresponds to the positional information of the picked up images of vehicle, and then, the present positional information is corrected based upon this comparison result, so that the precision of this present positional information of the vehicle can be increased.
The vehicle peripheral-area display apparatus of the present invention is featured by that the positional information detecting means is comprised of: a steering, amount detecting means for detecting a steering amount equivalent to a steering angle of the vehicle; a travel distance detecting means for detecting a travel amount equivalent to a travel distance of the vehicle; and an integration processing means for performing an integration process operation with respect to both the steering amount detected by the steering amount detecting means and the travel amount detected by the travel distance detecting means, whereby the own vehicle position of the vehicle is calculated as positional information.
As a consequence, in accordance with the vehicle peripheral-area display apparatus, since the integration process operation is carried out with respect to both the steering amount of the vehicle and the travel amount of this vehicle, the own vehicle position of the vehicle can be simply calculated as the positional information.
The vehicle peripheral-area display apparatus of the present invention is featured by comprised of: a picture data comparing means for comparing present picture data as to the peripheral area of the vehicle picked up by the image pick-up means with the picture data which is stored in the data storage means and corresponds to the positional information of the picked up images of vehicle; and a correction coefficient calculating means for calculating a correction coefficient for the integration process operation executed by the integration processing unit so as to correct the present positional information based upon an error of a portion where the present picture data is overlapped with the past picture data by the picture data comparing means.
As a consequence, in accordance with the vehicle peripheral-area display apparatus of the present invention, while the present picture data and the past picture data are compared with each other, which are related to the peripheral-area of the vehicle picked up by the image pick-up means, the correction coefficient of the integration process operation is calculated based upon the error contained in the portion where the present picture data is overlapped with the past picture data. As a consequence, the calculation precision of the positional information performed by the integration processing means 21 can be largely improved.
The vehicle peripheral-area display apparatus of the present invention is featured by that the picture composite means produces three-dimensional picture data based upon both the picture data corresponding to the present position information and picture data corresponding to such positional information located adjacent to the present positional information, and also combines the three-dimensional picture data with the picture data of the vehicle.
Accordingly, in accordance with the vehicle peripheral-area display apparatus of the present invention, while the picture composite means produces the three-dimensional picture data based upon the present positional information and also a plurality of picture data corresponding to the positional information located adjacent to this present positional information, this three-dimensional picture data is combined with the picture data of the own vehicle, so that the three-dimensional picture can be monitor-displayed.
The vehicle peripheral-area display apparatus of the present invention is featured by that the vehicle peripheral-area display apparatus is comprised of: a picture map producing means for producing a picture map based upon a plurality of positional information and also past picture data corresponding to the respective positional information, which are stored in the data storage means; and the display control means displays the picture map produced by the picture map producing means on the display means.
As a consequence, in accordance with the vehicle peripheral-area display apparatus of the present invention, while the picture map is produced based upon a plurality of positional information and also the past picture data corresponding to the respective positional information, which are stored in the data storage means, this produced picture map is displayed on the display means. As a result, such a real picture which could not be conventionally obtained may be utilized as the map, so that utilization of the user can be greatly improved.
The vehicle peripheral-area display apparatus of the present invention is featured by that the image pick-up means is comprised of: a backward image pick-up means for picking up a backward scene of the vehicle; a forward image pick-up means for picking up a forward scene of the vehicle; a travel direction detecting means for detecting a travel direction of the vehicle; and a control means for executing the image pick-up operation only by the forward image pick-up means when the travel direction detecting means detects a forward travel of the vehicle, and also for executing the image pick-up operation only by the backward image pick-up means when the travel direction detecting means detects a backward travel of the vehicle.
As a consequence, in accordance with the vehicle peripheral-area display apparatus of the present invention, the control means executes the image pick-up operation only by the forward image pick-up means when the traveling direction detecting means detects the forward travel of the vehicle whereas the control means performs the image pick-up operation only by the backward image pick-up means when traveling direction detecting means detects the backward travel of the vehicle. As a result, even when the user does not perform the switching operation between the backward image pick-up means and the forward image pick-up means, larger numbers of picture data are acquired, so that the traveling direction detecting effect can be furthermore improved.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a block diagram for shows a schematic arrangement side a vehicle peripheral-area display apparatus according to an embodiment of the present invention.
FIG. 2 is an explanatory diagram for representing a use condition of a vehicle which employs the vehicle peripheral-area display apparatus according to this embodiment.
FIG. 3 is a flow chart for describing a process operation of a CPU related to a peripheral-area display apparatus according to this embodiment.
FIG. 4 is a flow chart for describing a process operation of the CPU in such a case that a plane display is converted into a three-dimensional display in a peripheral-area display process operation according to this embodiment.
It should be understood that in these drawings, reference numeral 1 shows a vehicle peripheral-area display apparatus; reference numeral 11 represents a camera (image pick-up means) reference numeral 12 indicates a vehicle sensor (positional information detecting means); reference numeral 12 a denotes a steering sensor (steering amount detecting means); reference numeral 12 b is a wheel rotation sensor (drive distance detecting means); reference numeral 15 shows a memory (data storage means); reference numeral 15 a indicates a picture memory area (data storage means); reference numeral 16 represents a monitor display unit (display means); reference numeral 20 is a CPU; reference numeral 21 represents an integration processing unit (integration processing means); reference numeral 24 represents a memory control unit (picture composite means); reference numeral 25 denotes a picture composite process unit (picture composite means); reference numeral 26 indicates a display control unit (display control means); reference numeral 27 represents a picture data comparing process unit (picture data comparing means); reference numeral 28 shows a correction coefficient calculating unit (correction coefficient calculating means); reference numeral 29 shows a picture three-dimensional processing unit (picture composite means); and reference numeral 30 indicates a picture map producing unit (picture map producing means).
BEST MODE FOR CARRYING OUT THE INVENTION
Referring now to drawings, a description will now be made of a vehicle peripheral-area display apparatus according to an embodiment of the present invention. FIG. 1 is a block diagram showing a schematic arrangement inside a vehicle peripheral-area display apparatus according to an embodiment of the present invention. FIG. 2 is an explanatory diagram for representing a schematic structure of: a vehicle which employs the vehicle peripheral-area display apparatus according to this embodiment.
The vehicle peripheral-area display apparatus 1 shown in FIG. 1 is arranged by employing a camera 11 corresponding to an image pick-up means for picking up images of a peripheral area of a vehicle 2, a vehicle sensor 12 used to detect the own vehicle position of the vehicle 2 as positional information, a camera picture buffer 13 for buffering picture data (video data) of the peripheral area of the vehicle 2 picked up by the camera 11, an A/D converter 14 for converting the picture data buffered in this camera picture buffer 13 into digitally converted picture data, and a memory 15 corresponding to a data storage means for sequentially storing thereinto the digitally-converted picture data, and also for storing thereinto various data. The vehicle peripheral-area display apparatus 1 is further arranged by employing a monitor display unit 16 corresponding to a display means for displaying thereon various picture data, a warning display unit 17 for displaying a warning notice and the like, and a CPU 20 for controlling an entire arrangement of the vehicle peripheral-area display apparatus 1 via a CPU bus 18.
The vehicle sensor 12 includes a steering sensor 12 a and a wheel rotation sensor 12 b. The steering sensor 12 a corresponds to a steering amount detecting means for detecting a steering amount which is equivalent to a steering angle of the vehicle 2. The wheel rotation sensor 12 b corresponds to a drive distance detecting means for detecting a drive amount (travel amount) which is equivalent to a drive distance of the vehicle 2.
The CPU 20 includes an integration processing unit 21, an integration buffer 22, a picture arranging process unit 23, a memory control unit 24, a picture composite process unit 25, a display control unit 26, a picture data comparing process unit 17, and also a correction coefficient calculating unit 28. The integration processing unit 21 corresponds to an integration processing means for executing an integration process operation with respect to both the steering amount detected by the steering sensor 12 a and the drive amount detected by the wheel rotation sensor 12 b so as to calculate the own vehicle position of the vehicle 2 as positional information.
The integration buffer buffers the calculated positional information. The picture arranging process unit 22 executes a changing process operation of a camera view angle with respect to the picture data stored in the memory 15. The memory control unit 24 corresponds to a picture composite means for storing/controlling the picture data into the memory 15 in correspondence with the positional information acquired by picking up this picture data. The picture composite process unit 25 corresponds to a picture composite means in which while the past picture data corresponding to the present positional information is read out from the memory 15 under control of the memory control unit 24, this picture composite means combines vehicle shape data “X” as shown in FIG. 2(b) with this past picture data. The display control unit 26 corresponds to a display control means for displaying the picture data combined by this picture composite process unit 25 on the monitor display unit 16. The picture data comparing process unit 27 corresponds to a picture data comparing means for comparing present picture data of the peripheral area of the vehicle 2 picked up by the camera 11 with past picture data which corresponds to present positional information as to the picked up images of peripheral area of the vehicle 2. Also, the correction coefficient calculating unit 28 corresponds to a correction coefficient calculating means for calculating a correction coefficient of the integration process by the integration processing unit 21 in order that the present positional information should be corrected based upon such an error of an overlapped portion between the present picture data and the past picture data in this picture data comparing process unit 27.
Furthermore, this CPU 20 includes a picture three-dimensionally processing unit 29, and a picture map producing unit 30 c. This picture three-dimensionally processing unit 29 corresponds to such a picture composite means which produces three-dimensional picture data in the following manner. That is, a positional change of the same target point on the display screen, which is related to the same image pick-up target, is obtained from two sets of picture data with respect to positional information located adjacent to each other, and then, a three-dimensional coordinate value of the target point is obtained from a travel distance of the vehicle 2 and from the positional change appeared on the display screen. Also, the picture map producing unit 30 corresponds to a picture map producing means for producing a picture map based upon a plurality of positional information, and the past picture data corresponding to the respective positional information stored in the memory 15.
The memory 15 includes a picture memory area 15 a, a positional information memory area 15 b, an own vehicle shape data memory area 15 c, and an initial setting value memory area 15 d. The picture memory area 15 a sequentially stores thereinto the picture data picked up by the camera 11. The positional information memory area 15 b stores thereinto the positional information of the vehicle 2 in correspondence with the picture data when this picture data: is picked up. The own vehicle shape data memory area 15 c stores thereinto own vehicle shape data “X” of the vehicle 2, which is combined by the picture composite process unit 25. The initial setting value memory area 15 d stores thereinto initial setting values as to a setting position of the camera 11, a view angle of the camera 11, a distortion specification of the camera 11, and display range specifications of the monitor display unit 16, which may depend upon an automatic/manual drive mode and a vehicle speed direction.
FIG. 2 is an explanatory diagram for explaining an outer-view construction of the vehicle 2 which employs the vehicle peripheral-area display apparatus 1 according to this embodiment.
As shown in FIG. 2(a), while the camera 11 for picking up images of a backward range “Z” of this vehicle 2 is installed on a rear portion of this vehicle 2, the monitor display unit 16 is equipped within a driver's seat of the vehicle 2 in order that a picture picked up by the camera 11 may be displayed on the monitor display unit 26.
Next, operations of the vehicle peripheral-area display apparatus 1 according to the present embodiment will now be explained. FIG. 3 is a flow chart for explaining process operations of the CPU 20 related to a peripheral-area display process operation executed by the vehicle peripheral-area display apparatus 1 according to this embodiment.
The above-explained “peripheral-area display process operation” defined in FIG. 3 explains the following process operation. That is, normally, both picture data of a peripheral-area of the vehicle 2, which is picked up by the camera 11, and positional information of the vehicle 2, which corresponds to a image pick-up position of this peripheral area of the vehicle 2, are stored into the memory 11 in correspondence with these picture data and positional information. Furthermore, when the CPU judges such a fact that past picture data corresponding to the present positional information is stored into the memory 15, the picture data “X” of the own vehicle shape is combined with this past picture data, and thus, this composite picture data is displayed on the monitor display unit.
The CPU 20 indicated in FIG. 3 executes an initial setting operation (step S11). That is, this CPU20 reads out the initial setting value which has been stored in the initial setting value memory area 15 d, for instance, since the display range specification of the monitor display unit 16 is set, the CPU 20 may set the display range of the monitor display unit 16. Alternatively, for example, since the CPU 20 sets the camera angle, the distortion specification, the camera setting position, and the camera setting direction, the camera specification may be set.
After the CPU 20 executes the initial setting operation, the CPU 20 judges as to whether or not the present mode corresponds to such a display mode in which the peripheral area of the vehicle 2 is monitored/displayed on the monitor display unit 16 (step S12). It should be noted that the mode such as the display mode may be set by manipulating an operation key prepared on the monitor display unit 16.
When the CPU 20 judges that the present mode is not equal to the display mode, the CPU 20 judges that the present mode corresponds to a picture acquisition mode in which a picture of a peripheral area of the vehicle 2 is merely acquired without performing the monitor display operation. Thus, the CPU 20 acquires picture data which are sequentially picked up by the camera 11, and buffers these acquired picture data into the camera picture buffer 13 (step S13).
Furthermore, the integration processing unit 21 of the CPU 20 performs the integration processing operation with respect to both a steering amount sensed by the steering sensor 12 a and a drive amount sensed by the wheel rotation sensor 12 in order to detect a vehicle position picked up by this camera 11. As a result, the integration processing unit 21 of the CPU 20 detects present positional information of the vehicle (step S14).
The memory control unit 24 of the CPU 20 judges as to whether or not the past picture data which corresponds to the present positional information of the detected vehicle is stored into the picture memory area 15 a (step S15).
In the case that the memory control unit 24 judges such a fact that the picture data corresponding to the present positional information is stored in the picture memory area 15 a, the memory control unit 24 digitally converts the picture data by the A/D converter 14, which has been buffered into the camera picture buffer 13 at the step S13, and then stores this digitally-converted picture data into the picture memory area 15 a. Also, the memory control unit 24 stores the positional information of the vehicle detected at the step S14 into the vehicle positional information memory area 15 b in correspondence with this stored picture data (step S16).
Furthermore, the picture data comparing process unit 27 compares the present picture data corresponding to this vehicle positional information with the past picture data, so that this picture data comparing process unit 27 detects an error in such a portion where the present picture data is overlapped with the past picture data (step S17).
The correction coefficient calculating unit 28 calculates a correction efficient for the integration process operation by the integration processing unit 21 in order that the present positional information is corrected based upon the error detected by the picture data comparing process unit 27 (step S18). Then, the correction coefficient calculating unit 28 sets this calculated correction coefficient to the integration processing unit 21 (step S19) The process operation is advanced to a process step “M1” shown in this drawing so as to furthermore acquire pictures.
Also, in such a case that the memory control unit 24 judges that the past picture data corresponding to the present vehicle position is not stored at the step S15, this memory control unit 24 stores the picture data acquired at the step S13 into the picture memory area 15 a, and also stores the present positional information of the vehicle detected at the step S14 into the vehicle positional information memory area 15 b (step S20). Then, the process operation is advanced to the process step “M1” shown in this drawing in order to furthermore acquire pictures.
Also, when the CPU 20 judges that the present mode corresponds to the display mode at the step S12, the CPU 20 buffers the picture data picked up by the camera 11 into the camera picture buffer 13 (step S21), and furthermore, makes the integration processing unit 21 to detect present positional information of the vehicle 2 (step S22).
The memory control unit 24 judges as to whether or not such past picture data corresponding to the present vehicle positional information is stored in the picture memory area 15 a (step S23).
When the memory control unit 24 judges such a fact that the past picture data corresponding to the present vehicle position information is stored in the picture memory area 15 a, the memory control unit 24 stores the picture data acquired at the step S20 into the picture memory area 15 a, and stores the present positional information detected at the step S21 into the vehicle positional information memory area 15 b in correspondence with this picture data (step S24).
Furthermore, the picture data comparing process unit 27 compares the present picture data corresponding to this vehicle positional information with the past picture data, so that this picture data comparing process unit 27 detects an error in such a portion where the present picture data is overlapped with the past picture data (step S25).
The correction coefficient calculating unit 28 calculates a correction efficient for the integration process operation by the integration processing unit 21 in order that the present positional information is corrected based upon the error detected by the picture data comparing process unit 27 (step S26). Then, the correction coefficient calculating unit 28 sets this calculated correction coefficient to the integration processing unit 21 (step S27).
In addition, the picture composite process unit 25 produces a composite picture data from the past picture data and the present picture data. Then, the picture composite process unit 25 produces a picture data of a peripheral area of the vehicle 2 to be displayed on the monitor display unit 16 by selecting a present picture date in the range where the past picture data is overlapped with the present picture data. (step S28).
Furthermore, the picture composite process unit 25 reads the own vehicle shape data “X” under storage into the own vehicle shape data memory area 15 c, and then, combines this own vehicle shape data “X” with the picture data which is produced at the previous step S28 (step S29).
The display control unit 26 displays the picture data combined at the step S29 on the monitor display unit 26 (step S30). Then, the process operation is advanced to a process step “M2” in this drawing so as to further acquire a picture.
It should be understood that although such a picture of the lower portion of the vehicle 2 could not be displayed on the monitor as to the picture data acquired in real time in the conventional system, this picture can be displayed on the monitor by using the past picture data in the present invention.
When the memory control unit 24 judges such a fact that the past picture data corresponding to the present vehicle position information is not stored in the picture memory area 15 a, the memory control unit 24 stores the picture data acquired at the step S21 into the picture memory area 15 a, and stores the present positional information detected at the step S22 into the vehicle positional information memory area 15 b in correspondence with this picture data (step S31).
Furthermore, the picture composite process unit 25 reads the own vehicle shape data “X” under storage into the own vehicle shape data memory area 15 c, and then, combines this own vehicle shape data “X” with the picture data which corresponds to the present vehicle positional information (step S32).
The display control unit 26 monitor-displays the picture data combined at the step S32 on the monitor display unit 16 (step S33). Then, the process operation is advanced to a process step “M2” in this drawing so as to further acquire a picture.
It should also be noted that in accordance with the peripheral-area display process operation shown in FIG. 3, the pictures displayed on the monitor display unit 16 are the two-dimensionally-displayed pictures. Alternatively, since the process operation “A” indicated in FIG. 3 is replaced with a process operation as shown in FIG. 4, this picture may be three-dimensionally displayed. FIG. 4 is a flow chart for describing a process operation executed by the CPU 20 related to a three-dimensional representation.
This three-dimensional display process operation may be initiated by entering, for instance, a three-dimensional display initiation key prepared in the operation key of the monitor display unit 16.
As indicated in FIG. 4, after the process operation defined at the steps S23, S24, S25, S26, and S27 are carried out, the picture three-dimensionally processing unit 29 produces three-dimensional picture data in the following manner (step S41). That is, this picture three-dimensionally processing unit 29 compares the picture data corresponding to the present positional information being presently stored in the picture memory area 15 a with such a picture data corresponding to positional information which is located adjacent to this present positional information so as to acquire a positional change of the same target point on the display screen from these two sets of picture data. The same target point is related to the same imaging target subject. Then, the three-dimensionally processing unit 29 produces three-dimensional picture data by acquiring a three-dimensional coordinate value of the target point based upon both the travel distance (drive distance) of the vehicle 2 and the positional change on the display screen.
Furthermore, the picture three-dimensionally processing unit 29 calculates an interval between this imaging target article and the vehicle (step S42). The picture composite process unit 25 combines the own vehicle shape data “X” read out from the own vehicle shape data memory area 15 c with the produced three-dimensional picture data based upon the interval between the imaging target article and the vehicle, which is calculated in the picture three-dimensionally processing unit 29 (step S43).
Then, the picture composite process unit 25 displays this combined three-dimensional picture data on the monitor display unit 16 (step S44), and the process operation is advanced to the process step “M2” indicated in FIG. 3.
Also, after the process operations defined at the step S23 and S31 are carried out, the picture three-dimensionally processing unit 29 produces three-dimensional picture data in the following manner (step S45). That is, this picture three-dimensionally processing unit 29 compares the picture data corresponding to the present positional information being presently stored in the picture memory area 15 a with a picture data corresponding to positional information which is located adjacent to this present positional information so as to acquire a positional change of the same target point on the display screen from these two sets of picture data. The same target point is related to the same imaging target subject. Then, the three-dimensionally processing unit 29 produces three-dimensional picture data by acquiring a three-dimensional coordinate value of the target point based upon both the travel distance (drive distance) of the vehicle 2 and the positional change on the display screen.
Furthermore, the picture three-dimensionally processing unit 29 calculates an interval between this target article and the vehicle (step S46). The picture composite process unit 25 combines the own vehicle shape data “X” read out from the own vehicle shape data memory area 15 c with the produced three-dimensional picture data based upon the interval between the imaging target article and the vehicle, which is calculated in the picture three-dimensionally processing unit 29 (step S47).
Then, the picture composite process unit 25 displays this combined three-dimensional picture data on the monitor display unit 16 (step S48), and the process operation is advanced to the process step “M2” indicated in FIG. 3.
It should also be noted that in order to combine the own vehicle shape data “X” with the three-dimensional picture data, the interval between the imaging target article and the vehicle is calculated at the steps S42 and S46. Furthermore, since such an interval is calculated, when the CPU 20 thereafter senses such a fact that the vehicle 2 is approached to this imaging target article, this CPU 20 may notify via the warning display unit 17 to the user, such a warning notice that the vehicle most probably collides with the imaging target subject. Also, this CPU 20 may notify a steering guide for avoiding this collision via the warning display unit 17 to the user as to a collision-avoiding-measure indication.
Alternatively, in accordance with this embodiment, since both the picture data and the vehicle positional information are utilized which are stored in the picture memory area 15 a and the vehicle positional information memory area 15 b, the below-mentioned picture map may be formed.
The picture map producing unit 30 of the CPU 20 produces a picture map based upon the positional information stored in the picture memory area 15 a, and also the past picture data which are stored in the vehicle positional information memory area 15 b, and correspond to the respective positional information.
The display control unit 26 displays the picture map produced by the picture map producing unit 30 on the monitor display unit 16.
In accordance with this embodiment, while the picture data as to the peripheral area of the vehicle 2 and also the positional information of the vehicle acquired when these pictures are picked up are sequentially stored into both the picture memory area 15 a and the vehicle positional information memory area 15 b, the past picture data corresponding to the present positional information of the vehicle 2 is read out from the picture memory area 15 a. Then, the own vehicle shape data “X” is combined with this past picture data, and this combined picture data is displayed on the monitor display unit 16. As a result, even when a plurality of cameras 11 used to pick up all of the peripheral areas of the vehicle 2 are not mounted, not only the road surface of the lower portion of the vehicle body of this vehicle 2 can be displayed on the monitor, but also the peripheral area of the vehicle 2 picked up in the past stage can be displayed on the monitor.
As previously explained, since the load surface of the lower portion of the vehicle body of this vehicle 2 can be displayed on the monitor, for example, in such a case that the vehicle 2 is stored into a garage, this garaging work of the vehicle 2 can be smoothly carried out by observing the monitor screen.
Also, in accordance with this embodiment, while the present picture data and the past picture data are compared with each other, which are related to the present positional information of the vehicle 2, the correction coefficient of the integration process operation is calculated based upon the error contained in the portion where the present picture data is overlapped with the past picture data. As a consequence, the calculation precision of the positional information performed by the integration processing unit 21 can be largely improved.
Also, in accordance with this embodiment, while the three-dimensional picture data is produced based upon the present positional information and also a plurality of picture data corresponding to the positional information located adjacent to this present positional information, this three-dimensional picture data is combined with the own vehicle shape data “X”, so that the three-dimensional picture can be displayed on the monitor.
Further, in accordance with this embodiment, while the picture map is produced based upon a plurality of positional information stored in the picture memory area 15 a and also, the past picture data corresponding to the respective positional information, which are stored in the vehicle positional information memory area 15 b, this picture map is displayed on the monitor display unit 16. As a consequence, such a real picture which could not be conventionally obtained may be utilized as the map, so that utilization of the user can be greatly improved.
It should also be noted that in accordance with the above-explained embodiment, a description is made of such an example that the camera 11 is installed on the rear portion of the vehicle 2. Alternatively, if the vehicle peripheral-area display apparatus is equipped with a backward image pick-up means, a forward image pick-up means, and further, the CPU 20 is equipped with a traveling direction detecting means, and also a control means, then this vehicle peripheral-area display apparatus may acquire larger numbers of picture data without the switching operation by the user as to the backward image pick-up means and the forward image pick-up means, resulting in a higher effect. This backward image pick-up means functions as a camera for picking up pictures of the backward range of the vehicle 2. The forward image pick-up means functions as a camera for picking up pictures of the forward range of the vehicle 2. The traveling direction detecting means detects the traveling direction of the vehicle 2 by detecting, for example, a gear range of the vehicle 2.
The control means executes the image pick-up operation only by the forward image pick-up means when the traveling direction detecting means detects the forward travel of the vehicle 2, whereas the control means performs the image pick-up operation 5 only by the back ward image pick-up means when traveling direction detecting means detects the backward travel of the vehicle 2.
Also, in accordance with the above-explained embodiment, the peripheral areas of the traveling vehicle 2 are stored as the picture data into the picture memory area 15 a. As a result, after the traveling operation of the vehicle 2 is stopped, the contents of this picture memory area 15 a may be reproduced on the monitor display unit 16 in response to a predetermined operation. For instance, in such a case that this vehicle peripheral-area display apparatus is employed in a vehicle used in an automobile training school, since a trainee observes a picture displayed on the monitor display unit 16, this trainee can objectively recognize own driving conditions.
INDUSTRIAL APPLICABILITY
In accordance with the vehicle peripheral-area display apparatus of the present invention with employment of the above-described structure, while both the picture data as to the picked up pictures of peripheral area of the vehicle, and also the positional information of the vehicle acquired during this image pick-up operation are sequentially stored into the data storage means, the picture data corresponding to the present positional information of the vehicle is read out from the data storage means, and then, this read picture data is combined with such a picture data indicative of the shape of the vehicle. This combined picture data is displayed on the display means. As a consequence, even when a plurality of cameras which may pick up all of the peripheral areas of the vehicle are not mounted on the vehicle, not only the road surface of the lower portion of the vehicle body of the vehicle can be monitor-displayed, but also the past pictures of the peripheral area of the vehicle can be monitor-displayed.

Claims (7)

What is claimed is:
1. A vehicle peripheral-area display apparatus comprising:
an image pick-up unit for picking up images of a peripheral area of a vehicle;
a positional information detecting unit for detecting the own vehicle position of said vehicle as positional information;
a data storage unit for storing picture data of the peripheral area of the vehicle, the picture data is picked up by said image pick-up unit, and also storing said positional information of the vehicle;
a picture composite unit for reading out picture data corresponding to the positional information detected by said positional information detecting unit from said data storage unit, and for combining said read picture data with such picture data indicative of a shape of said vehicle; and
a display control unit for causing the picture data combined in said picture composite unit to be displayed on a display unit.
2. A vehicle peripheral-area display apparatus as claimed in claim 1 further comprising:
a picture data comparing unit for comparing present picture data as to the peripheral area of the vehicle picked up by said image pick-up unit with the picture data which is stored in said data storage unit and corresponds to the positional information of said vehicle,
wherein said positional information detecting unit corrects the detected present positional information based upon the comparison result of said picture data comparing unit.
3. A vehicle peripheral-area display apparatus as claimed in claim 1, wherein said positional information detecting unit includes:
a steering amount detecting unit for detecting a steering amount equivalent to a steering angle of said vehicle;
a travel distance detecting unit for detecting a travel amount equivalent to a travel distance of said vehicle; and
an integration processing unit for calculating the own vehicle position of said vehicle as positional information by performing an integration process operation with respect to both the steering amount detected by said steering amount detecting unit and the travel amount detected by said travel distance detecting unit.
4. A vehicle peripheral-area display apparatus as claimed in claim 3 further comprising:
a picture data comparing unit for comparing present picture data of the peripheral area of the vehicle picked up by said image pick-up unit with the picture data which is stored in said data storage unit and corresponds to the positional information of said vehicle; and
a correction coefficient calculating unit for calculating a correction coefficient for the integration process operation executed by said integration processing unit so as to correct the present positional information based upon an error of a portion where the present picture data is overlapped with the past picture data by said picture data comparing unit.
5. A vehicle peripheral-area display apparatus as claimed in claim 1,
wherein said picture composite unit produces three-dimensional picture data based upon the picture data corresponding to the present position information and picture data corresponding to such positional information located adjacent to said present positional information, and also combines said three-dimensional picture data with the picture data of the vehicle.
6. A vehicle peripheral-area display apparatus as claimed in claim 1 further comprising:
a picture map producing unit for producing a picture map based upon a plurality of positional information and also past picture data corresponding to the respective positional information, which are stored in said data storage unit,
wherein said display control unit displays said picture map produced by said picture map producing unit on said display unit.
7. A vehicle peripheral-area display apparatus as claimed in claim 1, wherein said image pick-up unit includes:
a backward image pick-up unit for image pick-up a backward scene of said vehicle;
a forward image pick-up unit for image pick-up a forward scene of said vehicle;
a travel direction detecting unit for detecting a travel direction of said vehicle; and
a control unit for executing the image pick-up operation only by said forward image pick-up unit when said travel direction detecting unit detects a forward travel of said vehicle, and also for executing the image pick-up operation only by said backward image pick-up unit when said travel direction detecting unit detects a backward travel of said vehicle.
US09/937,515 2000-01-31 2000-01-29 Vicinity display for car Expired - Fee Related US6515597B1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2000-022697 2000-01-31
JP2000022697A JP2001218197A (en) 2000-01-31 2000-01-31 Device for displaying periphery of vehicle
PCT/JP2001/000580 WO2001058164A1 (en) 2000-01-31 2001-01-29 Vicinity display for car

Publications (1)

Publication Number Publication Date
US6515597B1 true US6515597B1 (en) 2003-02-04

Family

ID=18548967

Family Applications (1)

Application Number Title Priority Date Filing Date
US09/937,515 Expired - Fee Related US6515597B1 (en) 2000-01-31 2000-01-29 Vicinity display for car

Country Status (5)

Country Link
US (1) US6515597B1 (en)
EP (1) EP1168846A4 (en)
JP (1) JP2001218197A (en)
AU (1) AU2884601A (en)
WO (1) WO2001058164A1 (en)

Cited By (84)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030165255A1 (en) * 2001-06-13 2003-09-04 Hirohiko Yanagawa Peripheral image processor of vehicle and recording medium
US20030222983A1 (en) * 2002-05-31 2003-12-04 Kunio Nobori Vehicle surroundings monitoring device, and image production method/program
US6708087B2 (en) * 2000-11-07 2004-03-16 Nissan Motor Co., Ltd. Display system for vehicle
US20040060756A1 (en) * 2002-09-18 2004-04-01 Fuji Jukogyo Kabushiki Kaisha Vehicle surroundings monitoring apparatus and traveling control system incorporating the apparatus
US20040145457A1 (en) * 1998-01-07 2004-07-29 Donnelly Corporation, A Corporation Of The State Of Michigan Accessory system suitable for use in a vehicle
US20050131587A1 (en) * 2003-12-12 2005-06-16 Toyota Jidosha Kabushiki Kaisha Control device for vehicle
US6923080B1 (en) * 2000-07-20 2005-08-02 Daimlerchrysler Ag Device and method for monitoring the surroundings of an object
US20050249379A1 (en) * 2004-04-23 2005-11-10 Autonetworks Technologies, Ltd. Vehicle periphery viewing apparatus
US20060028730A1 (en) * 1994-05-05 2006-02-09 Donnelly Corporation Electrochromic mirrors and devices
US20060085125A1 (en) * 2004-10-15 2006-04-20 Aisin Aw Co., Ltd. Driving support methods, apparatus, and programs
US20060271278A1 (en) * 2005-05-26 2006-11-30 Aisin Aw Co., Ltd. Parking assist systems, methods, and programs
US20070021876A1 (en) * 2005-05-12 2007-01-25 Denso Corporation Driver condition detecting device, in-vehicle alarm system and drive assistance system
US7304651B2 (en) * 2000-05-24 2007-12-04 Matsushita Electric Industrial Co., Ltd. Rendering device for generating a display image for drive assistance
US20070279493A1 (en) * 2006-06-05 2007-12-06 Fujitsu Limited Recording medium, parking support apparatus and parking support screen
US20080183355A1 (en) * 2000-03-02 2008-07-31 Donnelly Corporation Mirror system for a vehicle
US20080186724A1 (en) * 2001-01-23 2008-08-07 Donnelly Corporation Video mirror system for a vehicle
US20080198227A1 (en) * 2005-07-01 2008-08-21 Stephan Cieler Night Vision System
US20090122136A1 (en) * 2005-07-13 2009-05-14 Toyota Jidosha Kabushiki Kaisha Object detection device
US20090128310A1 (en) * 1998-02-18 2009-05-21 Donnelly Corporation Interior mirror system
US20090248300A1 (en) * 2008-03-31 2009-10-01 Sony Ericsson Mobile Communications Ab Methods and Apparatus for Viewing Previously-Recorded Multimedia Content from Original Perspective
US20100001881A1 (en) * 2007-01-16 2010-01-07 Pioneer Corporation Method of adjusting display device for vehicle and display device for vehicle
US7728721B2 (en) 1998-01-07 2010-06-01 Donnelly Corporation Accessory system suitable for use in a vehicle
US7815326B2 (en) 2002-06-06 2010-10-19 Donnelly Corporation Interior rearview mirror system
US7821697B2 (en) 1994-05-05 2010-10-26 Donnelly Corporation Exterior reflective mirror element for a vehicular rearview mirror assembly
US7826123B2 (en) 2002-09-20 2010-11-02 Donnelly Corporation Vehicular interior electrochromic rearview mirror assembly
US7832882B2 (en) 2002-06-06 2010-11-16 Donnelly Corporation Information mirror system
US7855755B2 (en) 2005-11-01 2010-12-21 Donnelly Corporation Interior rearview mirror assembly with display
US7859737B2 (en) 2002-09-20 2010-12-28 Donnelly Corporation Interior rearview mirror system for a vehicle
US7864399B2 (en) 2002-09-20 2011-01-04 Donnelly Corporation Reflective mirror assembly
US7888629B2 (en) 1998-01-07 2011-02-15 Donnelly Corporation Vehicular accessory mounting system with a forwardly-viewing camera
US7898719B2 (en) 2003-10-02 2011-03-01 Donnelly Corporation Rearview mirror assembly for vehicle
US7906756B2 (en) 2002-05-03 2011-03-15 Donnelly Corporation Vehicle rearview mirror system
US7914188B2 (en) 1997-08-25 2011-03-29 Donnelly Corporation Interior rearview mirror system for a vehicle
US7926960B2 (en) 1999-11-24 2011-04-19 Donnelly Corporation Interior rearview mirror system for vehicle
US8019505B2 (en) 2003-10-14 2011-09-13 Donnelly Corporation Vehicle information display
US8049640B2 (en) 2003-05-19 2011-11-01 Donnelly Corporation Mirror assembly for vehicle
US8083386B2 (en) 2001-01-23 2011-12-27 Donnelly Corporation Interior rearview mirror assembly with display device
US20120069188A1 (en) * 2009-05-29 2012-03-22 Fujitsu Ten Limited Image processing apparatus, electronic apparatus, and image processing method
US8154418B2 (en) 2008-03-31 2012-04-10 Magna Mirrors Of America, Inc. Interior rearview mirror system
US8194133B2 (en) 2000-03-02 2012-06-05 Donnelly Corporation Vehicular video mirror system
US8288711B2 (en) 1998-01-07 2012-10-16 Donnelly Corporation Interior rearview mirror system with forwardly-viewing camera and a control
US8294975B2 (en) 1997-08-25 2012-10-23 Donnelly Corporation Automotive rearview mirror assembly
US8339526B2 (en) 2006-03-09 2012-12-25 Gentex Corporation Vehicle rearview mirror assembly including a high intensity display
US20130022218A1 (en) * 2011-06-24 2013-01-24 Miyazawa Yusuke Sound control apparatus, program, and control method
US8462204B2 (en) 1995-05-22 2013-06-11 Donnelly Corporation Vehicular vision system
US20130163820A1 (en) * 2011-12-27 2013-06-27 Fujitsu Limited Survey apparatus, computer-readable storage medium and survey method
US8503062B2 (en) 2005-05-16 2013-08-06 Donnelly Corporation Rearview mirror element assembly for vehicle
US8525703B2 (en) 1998-04-08 2013-09-03 Donnelly Corporation Interior rearview mirror system
US8717196B2 (en) 2009-02-03 2014-05-06 Denso Corporation Display apparatus for vehicle
US8879139B2 (en) 2012-04-24 2014-11-04 Gentex Corporation Display mirror assembly
CN104335241A (en) * 2012-05-23 2015-02-04 株式会社电装 Vehicle surroundings image display control device, vehicle surroundings image display control method, non-transitory tangible computer-read medium comprising command containing said method, and image processing method effecting top-view conversion and display of image of vehicle surroundings
US9019091B2 (en) 1999-11-24 2015-04-28 Donnelly Corporation Interior rearview mirror system
US9487144B2 (en) 2008-10-16 2016-11-08 Magna Mirrors Of America, Inc. Interior mirror assembly with display
US9511715B2 (en) 2014-01-31 2016-12-06 Gentex Corporation Backlighting assembly for display for reducing cross-hatching
US9575315B2 (en) 2013-09-24 2017-02-21 Gentex Corporation Display mirror assembly
US9598018B2 (en) 2013-03-15 2017-03-21 Gentex Corporation Display mirror assembly
USD783480S1 (en) 2014-12-05 2017-04-11 Gentex Corporation Rearview device
US9694752B2 (en) 2014-11-07 2017-07-04 Gentex Corporation Full display mirror actuator
US9694751B2 (en) 2014-09-19 2017-07-04 Gentex Corporation Rearview assembly
US9720278B2 (en) 2015-01-22 2017-08-01 Gentex Corporation Low cost optical film stack
US9723275B2 (en) 2011-11-24 2017-08-01 Toyota Jidosha Kabushiki Kaisha Vehicle surroundings monitoring apparatus and vehicle surroundings monitoring method
US9744907B2 (en) 2014-12-29 2017-08-29 Gentex Corporation Vehicle vision system having adjustable displayed field of view
USD797627S1 (en) 2015-10-30 2017-09-19 Gentex Corporation Rearview mirror device
USD798207S1 (en) 2015-10-30 2017-09-26 Gentex Corporation Rearview mirror assembly
USD800618S1 (en) 2015-11-02 2017-10-24 Gentex Corporation Toggle paddle for a rear view device
US9834146B2 (en) 2014-04-01 2017-12-05 Gentex Corporation Automatic display mirror assembly
CN107539218A (en) * 2016-06-28 2018-01-05 爱信精机株式会社 Display control unit
USD809984S1 (en) 2016-12-07 2018-02-13 Gentex Corporation Rearview assembly
USD817238S1 (en) 2016-04-29 2018-05-08 Gentex Corporation Rearview device
CN108068696A (en) * 2016-11-17 2018-05-25 比亚迪股份有限公司 The display methods and display device of full-view image
US9995854B2 (en) 2015-04-20 2018-06-12 Gentex Corporation Rearview assembly with applique
US9994156B2 (en) 2015-10-30 2018-06-12 Gentex Corporation Rearview device
US10025138B2 (en) 2016-06-06 2018-07-17 Gentex Corporation Illuminating display with light gathering structure
US10071689B2 (en) 2014-11-13 2018-09-11 Gentex Corporation Rearview mirror system with a display
US10112540B2 (en) 2015-05-18 2018-10-30 Gentex Corporation Full display rearview device
US10131279B2 (en) 2014-12-03 2018-11-20 Gentex Corporation Display mirror assembly with an RF shield bezel
USD845851S1 (en) 2016-03-31 2019-04-16 Gentex Corporation Rearview device
USD854473S1 (en) 2016-12-16 2019-07-23 Gentex Corporation Rearview assembly
US10685623B2 (en) 2015-10-30 2020-06-16 Gentex Corporation Toggle paddle
US10705332B2 (en) 2014-03-21 2020-07-07 Gentex Corporation Tri-modal display mirror assembly
US10735638B2 (en) 2017-03-17 2020-08-04 Gentex Corporation Dual display reverse camera system
US10744941B2 (en) 2017-10-12 2020-08-18 Magna Electronics Inc. Vehicle vision system with bird's eye view display
US11178353B2 (en) 2015-06-22 2021-11-16 Gentex Corporation System and method for processing streamed video images to correct for flicker of amplitude-modulated lights
US11800050B2 (en) 2016-12-30 2023-10-24 Gentex Corporation Full display mirror with on-demand spotter view

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4980617B2 (en) * 2005-08-26 2012-07-18 株式会社岩根研究所 2D drawing and video composition display device
JP2007076425A (en) * 2005-09-12 2007-03-29 Aisin Aw Co Ltd Parking support method and parking support device
JP4622806B2 (en) * 2005-10-27 2011-02-02 アイシン・エィ・ダブリュ株式会社 Parking support method and parking support device
KR100906673B1 (en) * 2008-05-29 2009-07-07 현대자동차주식회사 Camera system for vehicle
DE102014204872B4 (en) 2014-03-17 2018-03-22 Volkswagen Aktiengesellschaft A method and display system for displaying environmental information of a vehicle
DE102015212370B4 (en) 2015-07-02 2023-02-23 Robert Bosch Gmbh Method and device for generating a representation of a vehicle environment of a vehicle
CN106828319A (en) * 2017-01-16 2017-06-13 惠州市德赛西威汽车电子股份有限公司 A kind of panoramic looking-around display methods for showing body bottom image

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0783693A (en) 1993-09-20 1995-03-28 Sumitomo Electric Ind Ltd Position detector
JPH07329638A (en) 1994-06-13 1995-12-19 Olympus Optical Co Ltd Vehicle exterior monitor
US5670935A (en) * 1993-02-26 1997-09-23 Donnelly Corporation Rearview vision system for vehicle including panoramic view
JPH10217852A (en) 1997-02-06 1998-08-18 Mitsubishi Electric Corp Rear monitoring device
US5798575A (en) * 1996-07-11 1998-08-25 Donnelly Corporation Vehicle mirror digital network and dynamically interactive mirror system
JPH1144548A (en) 1997-07-28 1999-02-16 Alpine Electron Inc Navigation system
JPH1172342A (en) 1998-03-12 1999-03-16 Aisin Aw Co Ltd Navigator for vehicle
JPH11160080A (en) 1997-12-01 1999-06-18 Harness Syst Tech Res Ltd Mobile body information system
US6115651A (en) * 1998-01-15 2000-09-05 Cruz; Diogenes J. Large vehicle blindspot monitor
US6122597A (en) * 1997-04-04 2000-09-19 Fuji Jukogyo Kabushiki Kaisha Vehicle monitoring apparatus
US6169572B1 (en) * 1996-06-06 2001-01-02 Fuji Jukogyo Kabushiki Kaisha Object recognizing apparatus for vehicle and the method thereof
US6370261B1 (en) * 1998-01-30 2002-04-09 Fuji Jukogyo Kabushiki Kaisha Vehicle surroundings monitoring apparatus

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05330425A (en) * 1992-05-29 1993-12-14 Railway Technical Res Inst Photographing control device
JP3528548B2 (en) * 1997-11-18 2004-05-17 トヨタ自動車株式会社 Vehicle moving image processing method and vehicle moving image processing device

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5670935A (en) * 1993-02-26 1997-09-23 Donnelly Corporation Rearview vision system for vehicle including panoramic view
JPH0783693A (en) 1993-09-20 1995-03-28 Sumitomo Electric Ind Ltd Position detector
JPH07329638A (en) 1994-06-13 1995-12-19 Olympus Optical Co Ltd Vehicle exterior monitor
US6169572B1 (en) * 1996-06-06 2001-01-02 Fuji Jukogyo Kabushiki Kaisha Object recognizing apparatus for vehicle and the method thereof
US5798575A (en) * 1996-07-11 1998-08-25 Donnelly Corporation Vehicle mirror digital network and dynamically interactive mirror system
JPH10217852A (en) 1997-02-06 1998-08-18 Mitsubishi Electric Corp Rear monitoring device
US6122597A (en) * 1997-04-04 2000-09-19 Fuji Jukogyo Kabushiki Kaisha Vehicle monitoring apparatus
JPH1144548A (en) 1997-07-28 1999-02-16 Alpine Electron Inc Navigation system
JPH11160080A (en) 1997-12-01 1999-06-18 Harness Syst Tech Res Ltd Mobile body information system
US6115651A (en) * 1998-01-15 2000-09-05 Cruz; Diogenes J. Large vehicle blindspot monitor
US6370261B1 (en) * 1998-01-30 2002-04-09 Fuji Jukogyo Kabushiki Kaisha Vehicle surroundings monitoring apparatus
JPH1172342A (en) 1998-03-12 1999-03-16 Aisin Aw Co Ltd Navigator for vehicle

Cited By (234)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060028730A1 (en) * 1994-05-05 2006-02-09 Donnelly Corporation Electrochromic mirrors and devices
US8164817B2 (en) 1994-05-05 2012-04-24 Donnelly Corporation Method of forming a mirrored bent cut glass shape for vehicular exterior rearview mirror assembly
US7821697B2 (en) 1994-05-05 2010-10-26 Donnelly Corporation Exterior reflective mirror element for a vehicular rearview mirror assembly
US7771061B2 (en) 1994-05-05 2010-08-10 Donnelly Corporation Display mirror assembly suitable for use in a vehicle
US8511841B2 (en) 1994-05-05 2013-08-20 Donnelly Corporation Vehicular blind spot indicator mirror
US20070183066A1 (en) * 1994-05-05 2007-08-09 Donnelly Corporation Signal mirror system for a vehicle
US7871169B2 (en) 1994-05-05 2011-01-18 Donnelly Corporation Vehicular signal mirror
US8559093B2 (en) 1995-04-27 2013-10-15 Donnelly Corporation Electrochromic mirror reflective element for vehicular rearview mirror assembly
US8462204B2 (en) 1995-05-22 2013-06-11 Donnelly Corporation Vehicular vision system
US8842176B2 (en) 1996-05-22 2014-09-23 Donnelly Corporation Automatic vehicle exterior light control
US8063753B2 (en) 1997-08-25 2011-11-22 Donnelly Corporation Interior rearview mirror system
US8294975B2 (en) 1997-08-25 2012-10-23 Donnelly Corporation Automotive rearview mirror assembly
US7898398B2 (en) 1997-08-25 2011-03-01 Donnelly Corporation Interior mirror system
US7914188B2 (en) 1997-08-25 2011-03-29 Donnelly Corporation Interior rearview mirror system for a vehicle
US8267559B2 (en) 1997-08-25 2012-09-18 Donnelly Corporation Interior rearview mirror assembly for a vehicle
US8100568B2 (en) 1997-08-25 2012-01-24 Donnelly Corporation Interior rearview mirror system for a vehicle
US8309907B2 (en) 1997-08-25 2012-11-13 Donnelly Corporation Accessory system suitable for use in a vehicle and accommodating a rain sensor
US8610992B2 (en) 1997-08-25 2013-12-17 Donnelly Corporation Variable transmission window
US8779910B2 (en) 1997-08-25 2014-07-15 Donnelly Corporation Interior rearview mirror system
US7994471B2 (en) 1998-01-07 2011-08-09 Donnelly Corporation Interior rearview mirror system with forwardly-viewing camera
US20080212215A1 (en) * 1998-01-07 2008-09-04 Donnelly Corporation Information display system for a vehicle
US8288711B2 (en) 1998-01-07 2012-10-16 Donnelly Corporation Interior rearview mirror system with forwardly-viewing camera and a control
US8134117B2 (en) 1998-01-07 2012-03-13 Donnelly Corporation Vehicular having a camera, a rain sensor and a single-ball interior electrochromic mirror assembly attached at an attachment element
US7916009B2 (en) 1998-01-07 2011-03-29 Donnelly Corporation Accessory mounting system suitable for use in a vehicle
US20040145457A1 (en) * 1998-01-07 2004-07-29 Donnelly Corporation, A Corporation Of The State Of Michigan Accessory system suitable for use in a vehicle
US7728721B2 (en) 1998-01-07 2010-06-01 Donnelly Corporation Accessory system suitable for use in a vehicle
US8094002B2 (en) 1998-01-07 2012-01-10 Donnelly Corporation Interior rearview mirror system
US7888629B2 (en) 1998-01-07 2011-02-15 Donnelly Corporation Vehicular accessory mounting system with a forwardly-viewing camera
US8325028B2 (en) 1998-01-07 2012-12-04 Donnelly Corporation Interior rearview mirror system
US7667579B2 (en) 1998-02-18 2010-02-23 Donnelly Corporation Interior mirror system
US20090128310A1 (en) * 1998-02-18 2009-05-21 Donnelly Corporation Interior mirror system
US9221399B2 (en) 1998-04-08 2015-12-29 Magna Mirrors Of America, Inc. Automotive communication system
US8525703B2 (en) 1998-04-08 2013-09-03 Donnelly Corporation Interior rearview mirror system
US8884788B2 (en) 1998-04-08 2014-11-11 Donnelly Corporation Automotive communication system
US9481306B2 (en) 1998-04-08 2016-11-01 Donnelly Corporation Automotive communication system
US9278654B2 (en) 1999-11-24 2016-03-08 Donnelly Corporation Interior rearview mirror system for vehicle
US10144355B2 (en) 1999-11-24 2018-12-04 Donnelly Corporation Interior rearview mirror system for vehicle
US8162493B2 (en) 1999-11-24 2012-04-24 Donnelly Corporation Interior rearview mirror assembly for vehicle
US9376061B2 (en) 1999-11-24 2016-06-28 Donnelly Corporation Accessory system of a vehicle
US9019091B2 (en) 1999-11-24 2015-04-28 Donnelly Corporation Interior rearview mirror system
US7926960B2 (en) 1999-11-24 2011-04-19 Donnelly Corporation Interior rearview mirror system for vehicle
US9014966B2 (en) 2000-03-02 2015-04-21 Magna Electronics Inc. Driver assist system for vehicle
US20080183355A1 (en) * 2000-03-02 2008-07-31 Donnelly Corporation Mirror system for a vehicle
US9019090B2 (en) 2000-03-02 2015-04-28 Magna Electronics Inc. Vision system for vehicle
US8908039B2 (en) 2000-03-02 2014-12-09 Donnelly Corporation Vehicular video mirror system
US8271187B2 (en) 2000-03-02 2012-09-18 Donnelly Corporation Vehicular video mirror system
US7711479B2 (en) 2000-03-02 2010-05-04 Donnelly Corporation Rearview assembly with display
US9315151B2 (en) 2000-03-02 2016-04-19 Magna Electronics Inc. Driver assist system for vehicle
US20090290369A1 (en) * 2000-03-02 2009-11-26 Donnelly Corporation information display system for a vehicle
US20070132567A1 (en) * 2000-03-02 2007-06-14 Donnelly Corporation Video mirror system suitable for use in a vehicle
US20090174776A1 (en) * 2000-03-02 2009-07-09 Donnelly Corporation Rearview assembly with display
US8676491B2 (en) 2000-03-02 2014-03-18 Magna Electronics Inc. Driver assist system for vehicle
US8194133B2 (en) 2000-03-02 2012-06-05 Donnelly Corporation Vehicular video mirror system
US7822543B2 (en) 2000-03-02 2010-10-26 Donnelly Corporation Video display system for vehicle
US9783114B2 (en) 2000-03-02 2017-10-10 Donnelly Corporation Vehicular video mirror system
US10239457B2 (en) 2000-03-02 2019-03-26 Magna Electronics Inc. Vehicular vision system
US8179236B2 (en) 2000-03-02 2012-05-15 Donnelly Corporation Video mirror system suitable for use in a vehicle
US9809171B2 (en) 2000-03-02 2017-11-07 Magna Electronics Inc. Vision system for vehicle
US8000894B2 (en) 2000-03-02 2011-08-16 Donnelly Corporation Vehicular wireless communication system
US8427288B2 (en) 2000-03-02 2013-04-23 Donnelly Corporation Rear vision system for a vehicle
US8044776B2 (en) 2000-03-02 2011-10-25 Donnelly Corporation Rear vision system for vehicle
US9809168B2 (en) 2000-03-02 2017-11-07 Magna Electronics Inc. Driver assist system for vehicle
US10179545B2 (en) 2000-03-02 2019-01-15 Magna Electronics Inc. Park-aid system for vehicle
US8121787B2 (en) 2000-03-02 2012-02-21 Donnelly Corporation Vehicular video mirror system
US10131280B2 (en) 2000-03-02 2018-11-20 Donnelly Corporation Vehicular video mirror system
US10053013B2 (en) 2000-03-02 2018-08-21 Magna Electronics Inc. Vision system for vehicle
US8095310B2 (en) 2000-03-02 2012-01-10 Donnelly Corporation Video mirror system for a vehicle
US8543330B2 (en) 2000-03-02 2013-09-24 Donnelly Corporation Driver assist system for vehicle
US7304651B2 (en) * 2000-05-24 2007-12-04 Matsushita Electric Industrial Co., Ltd. Rendering device for generating a display image for drive assistance
US6923080B1 (en) * 2000-07-20 2005-08-02 Daimlerchrysler Ag Device and method for monitoring the surroundings of an object
US6708087B2 (en) * 2000-11-07 2004-03-16 Nissan Motor Co., Ltd. Display system for vehicle
US9694749B2 (en) 2001-01-23 2017-07-04 Magna Electronics Inc. Trailer hitching aid system for vehicle
US9352623B2 (en) 2001-01-23 2016-05-31 Magna Electronics Inc. Trailer hitching aid system for vehicle
US7731403B2 (en) 2001-01-23 2010-06-08 Donnelly Corpoation Lighting system for a vehicle, with high-intensity power LED
US8083386B2 (en) 2001-01-23 2011-12-27 Donnelly Corporation Interior rearview mirror assembly with display device
US8072318B2 (en) 2001-01-23 2011-12-06 Donnelly Corporation Video mirror system for vehicle
US10272839B2 (en) 2001-01-23 2019-04-30 Magna Electronics Inc. Rear seat occupant monitoring system for vehicle
US20080186724A1 (en) * 2001-01-23 2008-08-07 Donnelly Corporation Video mirror system for a vehicle
US8654433B2 (en) 2001-01-23 2014-02-18 Magna Mirrors Of America, Inc. Rearview mirror assembly for vehicle
US8653959B2 (en) 2001-01-23 2014-02-18 Donnelly Corporation Video mirror system for a vehicle
US20080225538A1 (en) * 2001-01-23 2008-09-18 Donnelly Corporation Lighting system for a vehicle, with high-intensity power led
US20030165255A1 (en) * 2001-06-13 2003-09-04 Hirohiko Yanagawa Peripheral image processor of vehicle and recording medium
US7317813B2 (en) * 2001-06-13 2008-01-08 Denso Corporation Vehicle vicinity image-processing apparatus and recording medium
US7906756B2 (en) 2002-05-03 2011-03-15 Donnelly Corporation Vehicle rearview mirror system
US8106347B2 (en) 2002-05-03 2012-01-31 Donnelly Corporation Vehicle rearview mirror system
US8304711B2 (en) 2002-05-03 2012-11-06 Donnelly Corporation Vehicle rearview mirror system
US7110021B2 (en) * 2002-05-31 2006-09-19 Matsushita Electric Industrial Co., Ltd. Vehicle surroundings monitoring device, and image production method/program
US20030222983A1 (en) * 2002-05-31 2003-12-04 Kunio Nobori Vehicle surroundings monitoring device, and image production method/program
US8608327B2 (en) 2002-06-06 2013-12-17 Donnelly Corporation Automatic compass system for vehicle
US8282226B2 (en) 2002-06-06 2012-10-09 Donnelly Corporation Interior rearview mirror system
US8047667B2 (en) 2002-06-06 2011-11-01 Donnelly Corporation Vehicular interior rearview mirror system
US7832882B2 (en) 2002-06-06 2010-11-16 Donnelly Corporation Information mirror system
US8177376B2 (en) 2002-06-06 2012-05-15 Donnelly Corporation Vehicular interior rearview mirror system
US7815326B2 (en) 2002-06-06 2010-10-19 Donnelly Corporation Interior rearview mirror system
US7918570B2 (en) 2002-06-06 2011-04-05 Donnelly Corporation Vehicular interior rearview information mirror system
US8465163B2 (en) 2002-06-06 2013-06-18 Donnelly Corporation Interior rearview mirror system
US8465162B2 (en) 2002-06-06 2013-06-18 Donnelly Corporation Vehicular interior rearview mirror system
US7725261B2 (en) * 2002-09-18 2010-05-25 Fuji Jukogyo Kabushiki Kaisha Vehicle surroundings monitoring apparatus and traveling control system incorporating the apparatus
US20040060756A1 (en) * 2002-09-18 2004-04-01 Fuji Jukogyo Kabushiki Kaisha Vehicle surroundings monitoring apparatus and traveling control system incorporating the apparatus
US8797627B2 (en) 2002-09-20 2014-08-05 Donnelly Corporation Exterior rearview mirror assembly
US8506096B2 (en) 2002-09-20 2013-08-13 Donnelly Corporation Variable reflectance mirror reflective element for exterior mirror assembly
US9073491B2 (en) 2002-09-20 2015-07-07 Donnelly Corporation Exterior rearview mirror assembly
US10661716B2 (en) 2002-09-20 2020-05-26 Donnelly Corporation Vehicular exterior electrically variable reflectance mirror reflective element assembly
US7864399B2 (en) 2002-09-20 2011-01-04 Donnelly Corporation Reflective mirror assembly
US9090211B2 (en) 2002-09-20 2015-07-28 Donnelly Corporation Variable reflectance mirror reflective element for exterior mirror assembly
US10538202B2 (en) 2002-09-20 2020-01-21 Donnelly Corporation Method of manufacturing variable reflectance mirror reflective element for exterior mirror assembly
US8335032B2 (en) 2002-09-20 2012-12-18 Donnelly Corporation Reflective mirror assembly
US7859737B2 (en) 2002-09-20 2010-12-28 Donnelly Corporation Interior rearview mirror system for a vehicle
US8400704B2 (en) 2002-09-20 2013-03-19 Donnelly Corporation Interior rearview mirror system for a vehicle
US8727547B2 (en) 2002-09-20 2014-05-20 Donnelly Corporation Variable reflectance mirror reflective element for exterior mirror assembly
US10363875B2 (en) 2002-09-20 2019-07-30 Donnelly Corportion Vehicular exterior electrically variable reflectance mirror reflective element assembly
US7826123B2 (en) 2002-09-20 2010-11-02 Donnelly Corporation Vehicular interior electrochromic rearview mirror assembly
US10029616B2 (en) 2002-09-20 2018-07-24 Donnelly Corporation Rearview mirror assembly for vehicle
US9341914B2 (en) 2002-09-20 2016-05-17 Donnelly Corporation Variable reflectance mirror reflective element for exterior mirror assembly
US9545883B2 (en) 2002-09-20 2017-01-17 Donnelly Corporation Exterior rearview mirror assembly
US8228588B2 (en) 2002-09-20 2012-07-24 Donnelly Corporation Interior rearview mirror information display system for a vehicle
US9878670B2 (en) 2002-09-20 2018-01-30 Donnelly Corporation Variable reflectance mirror reflective element for exterior mirror assembly
US8277059B2 (en) 2002-09-20 2012-10-02 Donnelly Corporation Vehicular electrochromic interior rearview mirror assembly
US10449903B2 (en) 2003-05-19 2019-10-22 Donnelly Corporation Rearview mirror assembly for vehicle
US9557584B2 (en) 2003-05-19 2017-01-31 Donnelly Corporation Rearview mirror assembly for vehicle
US9783115B2 (en) 2003-05-19 2017-10-10 Donnelly Corporation Rearview mirror assembly for vehicle
US8049640B2 (en) 2003-05-19 2011-11-01 Donnelly Corporation Mirror assembly for vehicle
US10166927B2 (en) 2003-05-19 2019-01-01 Donnelly Corporation Rearview mirror assembly for vehicle
US8508384B2 (en) 2003-05-19 2013-08-13 Donnelly Corporation Rearview mirror assembly for vehicle
US10829052B2 (en) 2003-05-19 2020-11-10 Donnelly Corporation Rearview mirror assembly for vehicle
US11433816B2 (en) 2003-05-19 2022-09-06 Magna Mirrors Of America, Inc. Vehicular interior rearview mirror assembly with cap portion
US8325055B2 (en) 2003-05-19 2012-12-04 Donnelly Corporation Mirror assembly for vehicle
US8179586B2 (en) 2003-10-02 2012-05-15 Donnelly Corporation Rearview mirror assembly for vehicle
US8705161B2 (en) 2003-10-02 2014-04-22 Donnelly Corporation Method of manufacturing a reflective element for a vehicular rearview mirror assembly
US7898719B2 (en) 2003-10-02 2011-03-01 Donnelly Corporation Rearview mirror assembly for vehicle
US8379289B2 (en) 2003-10-02 2013-02-19 Donnelly Corporation Rearview mirror assembly for vehicle
US8019505B2 (en) 2003-10-14 2011-09-13 Donnelly Corporation Vehicle information display
US8577549B2 (en) 2003-10-14 2013-11-05 Donnelly Corporation Information display system for a vehicle
US8095260B1 (en) 2003-10-14 2012-01-10 Donnelly Corporation Vehicle information display
US8170748B1 (en) 2003-10-14 2012-05-01 Donnelly Corporation Vehicle information display system
US8355839B2 (en) 2003-10-14 2013-01-15 Donnelly Corporation Vehicle vision system with night vision function
US20050131587A1 (en) * 2003-12-12 2005-06-16 Toyota Jidosha Kabushiki Kaisha Control device for vehicle
US8494741B2 (en) * 2003-12-12 2013-07-23 Toyota Jidosha Kabushiki Kaisha Control device for vehicle
US20050249379A1 (en) * 2004-04-23 2005-11-10 Autonetworks Technologies, Ltd. Vehicle periphery viewing apparatus
US7505047B2 (en) * 2004-04-23 2009-03-17 Autonetworks Technologies, Ltd. Vehicle periphery viewing apparatus
US7519471B2 (en) * 2004-10-15 2009-04-14 Aisin Aw Co., Ltd. Driving support methods, apparatus, and programs
US20060085125A1 (en) * 2004-10-15 2006-04-20 Aisin Aw Co., Ltd. Driving support methods, apparatus, and programs
US8282253B2 (en) 2004-11-22 2012-10-09 Donnelly Corporation Mirror reflective element sub-assembly for exterior rearview mirror of a vehicle
US20070021876A1 (en) * 2005-05-12 2007-01-25 Denso Corporation Driver condition detecting device, in-vehicle alarm system and drive assistance system
US7769498B2 (en) * 2005-05-12 2010-08-03 Denso Corporation Driver condition detecting device, in-vehicle alarm system and drive assistance system
US8503062B2 (en) 2005-05-16 2013-08-06 Donnelly Corporation Rearview mirror element assembly for vehicle
US20060271278A1 (en) * 2005-05-26 2006-11-30 Aisin Aw Co., Ltd. Parking assist systems, methods, and programs
US7643935B2 (en) * 2005-05-26 2010-01-05 Aisin Aw Co., Ltd. Parking assist systems, methods, and programs
US8878932B2 (en) * 2005-07-01 2014-11-04 Continental Automotive Gmbh System and method for detecting the surrounding environment of a motor vehicle using as adjustable infrared night vision system
US20080198227A1 (en) * 2005-07-01 2008-08-21 Stephan Cieler Night Vision System
US20090122136A1 (en) * 2005-07-13 2009-05-14 Toyota Jidosha Kabushiki Kaisha Object detection device
US8833987B2 (en) 2005-09-14 2014-09-16 Donnelly Corporation Mirror reflective element sub-assembly for exterior rearview mirror of a vehicle
US9694753B2 (en) 2005-09-14 2017-07-04 Magna Mirrors Of America, Inc. Mirror reflective element sub-assembly for exterior rearview mirror of a vehicle
US11072288B2 (en) 2005-09-14 2021-07-27 Magna Mirrors Of America, Inc. Vehicular exterior rearview mirror assembly with blind spot indicator element
US10150417B2 (en) 2005-09-14 2018-12-11 Magna Mirrors Of America, Inc. Mirror reflective element sub-assembly for exterior rearview mirror of a vehicle
US10308186B2 (en) 2005-09-14 2019-06-04 Magna Mirrors Of America, Inc. Vehicular exterior rearview mirror assembly with blind spot indicator
US9045091B2 (en) 2005-09-14 2015-06-02 Donnelly Corporation Mirror reflective element sub-assembly for exterior rearview mirror of a vehicle
US9758102B1 (en) 2005-09-14 2017-09-12 Magna Mirrors Of America, Inc. Mirror reflective element sub-assembly for exterior rearview mirror of a vehicle
US11285879B2 (en) 2005-09-14 2022-03-29 Magna Mirrors Of America, Inc. Vehicular exterior rearview mirror assembly with blind spot indicator element
US10829053B2 (en) 2005-09-14 2020-11-10 Magna Mirrors Of America, Inc. Vehicular exterior rearview mirror assembly with blind spot indicator
US11124121B2 (en) 2005-11-01 2021-09-21 Magna Electronics Inc. Vehicular vision system
US7855755B2 (en) 2005-11-01 2010-12-21 Donnelly Corporation Interior rearview mirror assembly with display
US8339526B2 (en) 2006-03-09 2012-12-25 Gentex Corporation Vehicle rearview mirror assembly including a high intensity display
US20070279493A1 (en) * 2006-06-05 2007-12-06 Fujitsu Limited Recording medium, parking support apparatus and parking support screen
US7554461B2 (en) * 2006-06-05 2009-06-30 Fujitsu Limited Recording medium, parking support apparatus and parking support screen
US20100001881A1 (en) * 2007-01-16 2010-01-07 Pioneer Corporation Method of adjusting display device for vehicle and display device for vehicle
US8508383B2 (en) 2008-03-31 2013-08-13 Magna Mirrors of America, Inc Interior rearview mirror system
US20090248300A1 (en) * 2008-03-31 2009-10-01 Sony Ericsson Mobile Communications Ab Methods and Apparatus for Viewing Previously-Recorded Multimedia Content from Original Perspective
US10175477B2 (en) 2008-03-31 2019-01-08 Magna Mirrors Of America, Inc. Display system for vehicle
US8154418B2 (en) 2008-03-31 2012-04-10 Magna Mirrors Of America, Inc. Interior rearview mirror system
US11577652B2 (en) 2008-10-16 2023-02-14 Magna Mirrors Of America, Inc. Vehicular video camera display system
US11807164B2 (en) 2008-10-16 2023-11-07 Magna Mirrors Of America, Inc. Vehicular video camera display system
US11021107B2 (en) 2008-10-16 2021-06-01 Magna Mirrors Of America, Inc. Vehicular interior rearview mirror system with display
US10583782B2 (en) 2008-10-16 2020-03-10 Magna Mirrors Of America, Inc. Interior mirror assembly with display
US9487144B2 (en) 2008-10-16 2016-11-08 Magna Mirrors Of America, Inc. Interior mirror assembly with display
US8717196B2 (en) 2009-02-03 2014-05-06 Denso Corporation Display apparatus for vehicle
US9077861B2 (en) * 2009-05-29 2015-07-07 Fujitsu Ten Limited Image processing apparatus, electronic apparatus, and image processing method
CN104660985A (en) * 2009-05-29 2015-05-27 富士通天株式会社 Image processing apparatus, electronic apparatus, and image processing method
CN102450007A (en) * 2009-05-29 2012-05-09 富士通天株式会社 Image processing apparatus, electronic apparatus, and image processing method
CN104660985B (en) * 2009-05-29 2018-02-13 富士通天株式会社 Image processing equipment, electronic equipment and image processing method
CN102450007B (en) * 2009-05-29 2015-12-09 富士通天株式会社 Image processing equipment, electronic equipment and image processing method
US20150262488A1 (en) * 2009-05-29 2015-09-17 Fujitsu Ten Limited Image processing apparatus, electronic apparatus, and image processing method
US20120069188A1 (en) * 2009-05-29 2012-03-22 Fujitsu Ten Limited Image processing apparatus, electronic apparatus, and image processing method
US10339811B2 (en) * 2009-05-29 2019-07-02 Fujitsu Ten Limited Image processing apparatus, electronic apparatus, and image processing method
US20130022218A1 (en) * 2011-06-24 2013-01-24 Miyazawa Yusuke Sound control apparatus, program, and control method
US9723275B2 (en) 2011-11-24 2017-08-01 Toyota Jidosha Kabushiki Kaisha Vehicle surroundings monitoring apparatus and vehicle surroundings monitoring method
US9646213B2 (en) * 2011-12-27 2017-05-09 Fujitsu Limited Survey apparatus, computer-readable storage medium and survey method
US20130163820A1 (en) * 2011-12-27 2013-06-27 Fujitsu Limited Survey apparatus, computer-readable storage medium and survey method
US9057875B2 (en) 2012-04-24 2015-06-16 Gentex Corporation Display mirror assembly
US9505349B2 (en) 2012-04-24 2016-11-29 Gentex Corporation Display mirror assembly
US8879139B2 (en) 2012-04-24 2014-11-04 Gentex Corporation Display mirror assembly
US20150070394A1 (en) * 2012-05-23 2015-03-12 Denso Corporation Vehicle surrounding image display control device, vehicle surrounding image display control method, non-transitory tangible computer-readable medium comprising command including the method, and image processing method executing top view conversion and display of image of vehicle surroundings
CN104335241B (en) * 2012-05-23 2017-04-12 株式会社电装 Vehicle surroundings image display control device, display method and image processing method
CN104335241A (en) * 2012-05-23 2015-02-04 株式会社电装 Vehicle surroundings image display control device, vehicle surroundings image display control method, non-transitory tangible computer-read medium comprising command containing said method, and image processing method effecting top-view conversion and display of image of vehicle surroundings
US9598018B2 (en) 2013-03-15 2017-03-21 Gentex Corporation Display mirror assembly
US9575315B2 (en) 2013-09-24 2017-02-21 Gentex Corporation Display mirror assembly
US10739591B2 (en) 2013-09-24 2020-08-11 Gentex Corporation Display mirror assembly
US10018843B2 (en) 2013-09-24 2018-07-10 Gentex Corporation Display mirror assembly
US9511715B2 (en) 2014-01-31 2016-12-06 Gentex Corporation Backlighting assembly for display for reducing cross-hatching
US10705332B2 (en) 2014-03-21 2020-07-07 Gentex Corporation Tri-modal display mirror assembly
US9834146B2 (en) 2014-04-01 2017-12-05 Gentex Corporation Automatic display mirror assembly
US9694751B2 (en) 2014-09-19 2017-07-04 Gentex Corporation Rearview assembly
US10343608B2 (en) 2014-09-19 2019-07-09 Gentex Corporation Rearview assembly
US9694752B2 (en) 2014-11-07 2017-07-04 Gentex Corporation Full display mirror actuator
US10071689B2 (en) 2014-11-13 2018-09-11 Gentex Corporation Rearview mirror system with a display
US10131279B2 (en) 2014-12-03 2018-11-20 Gentex Corporation Display mirror assembly with an RF shield bezel
USD783480S1 (en) 2014-12-05 2017-04-11 Gentex Corporation Rearview device
US9744907B2 (en) 2014-12-29 2017-08-29 Gentex Corporation Vehicle vision system having adjustable displayed field of view
US10195995B2 (en) 2014-12-29 2019-02-05 Gentex Corporation Vehicle vision system having adjustable displayed field of view
US9720278B2 (en) 2015-01-22 2017-08-01 Gentex Corporation Low cost optical film stack
US9995854B2 (en) 2015-04-20 2018-06-12 Gentex Corporation Rearview assembly with applique
US10823882B2 (en) 2015-04-20 2020-11-03 Gentex Corporation Rearview assembly with applique
US10112540B2 (en) 2015-05-18 2018-10-30 Gentex Corporation Full display rearview device
US10807535B2 (en) 2015-05-18 2020-10-20 Gentex Corporation Full display rearview device
US11178353B2 (en) 2015-06-22 2021-11-16 Gentex Corporation System and method for processing streamed video images to correct for flicker of amplitude-modulated lights
US9994156B2 (en) 2015-10-30 2018-06-12 Gentex Corporation Rearview device
USD797627S1 (en) 2015-10-30 2017-09-19 Gentex Corporation Rearview mirror device
USD798207S1 (en) 2015-10-30 2017-09-26 Gentex Corporation Rearview mirror assembly
US10685623B2 (en) 2015-10-30 2020-06-16 Gentex Corporation Toggle paddle
USD800618S1 (en) 2015-11-02 2017-10-24 Gentex Corporation Toggle paddle for a rear view device
USD845851S1 (en) 2016-03-31 2019-04-16 Gentex Corporation Rearview device
USD817238S1 (en) 2016-04-29 2018-05-08 Gentex Corporation Rearview device
US10025138B2 (en) 2016-06-06 2018-07-17 Gentex Corporation Illuminating display with light gathering structure
CN107539218B (en) * 2016-06-28 2022-06-21 株式会社爱信 Display control device
CN107539218A (en) * 2016-06-28 2018-01-05 爱信精机株式会社 Display control unit
CN108068696A (en) * 2016-11-17 2018-05-25 比亚迪股份有限公司 The display methods and display device of full-view image
USD809984S1 (en) 2016-12-07 2018-02-13 Gentex Corporation Rearview assembly
USD924761S1 (en) 2016-12-16 2021-07-13 Gentex Corporation Rearview assembly
USD854473S1 (en) 2016-12-16 2019-07-23 Gentex Corporation Rearview assembly
US11800050B2 (en) 2016-12-30 2023-10-24 Gentex Corporation Full display mirror with on-demand spotter view
US10735638B2 (en) 2017-03-17 2020-08-04 Gentex Corporation Dual display reverse camera system
US10744941B2 (en) 2017-10-12 2020-08-18 Magna Electronics Inc. Vehicle vision system with bird's eye view display
US11242004B2 (en) 2017-10-12 2022-02-08 Magna Electronics Inc. Method of generating images for display for vehicular vision system
US11618383B2 (en) 2017-10-12 2023-04-04 Magna Electronics Inc. Vehicular vision system with display of combined images

Also Published As

Publication number Publication date
JP2001218197A (en) 2001-08-10
EP1168846A4 (en) 2005-01-19
AU2884601A (en) 2001-08-14
EP1168846A1 (en) 2002-01-02
WO2001058164A1 (en) 2001-08-09

Similar Documents

Publication Publication Date Title
US6515597B1 (en) Vicinity display for car
JP4815993B2 (en) Parking support method and parking support device
US8446268B2 (en) System for displaying views of vehicle and its surroundings
US10363872B2 (en) Periphery monitoring device
JP4863791B2 (en) Vehicle peripheral image generation apparatus and image switching method
JP4639753B2 (en) Driving assistance device
JP4622806B2 (en) Parking support method and parking support device
JP4818816B2 (en) Parking assistance program and parking assistance device
US8139114B2 (en) Surroundings monitoring apparatus and surroundings monitoring method for reducing distortion caused by camera position displacement
US20060119472A1 (en) Driving support apparatus and driving support method
EP1803602A1 (en) Driving assist method and driving assist apparatus
US6366221B1 (en) Rendering device
EP1038734A1 (en) Driving assisting device and recording medium
US20070057816A1 (en) Parking assist method and parking assist apparatus
US20030045973A1 (en) Motor vehicle parking support unit and method thereof
US20130096820A1 (en) Virtual display system for a vehicle
CN110877572A (en) Periphery monitoring device
JP2007266930A (en) Driving assist method and driving support apparatus
JP6642306B2 (en) Perimeter monitoring device
JP4590962B2 (en) Vehicle periphery monitoring device
JP7426174B2 (en) Vehicle surrounding image display system and vehicle surrounding image display method
US6463363B1 (en) Back monitoring apparatus for vehicle
JP2003252151A (en) Parking support system
JP4561512B2 (en) Parking support method and parking support device
JP5651491B2 (en) Image display system, image display apparatus, and image display method

Legal Events

Date Code Title Description
AS Assignment

Owner name: MATSUSHITA ELECTRIC INDUSTRIAL CO., LTD., JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:WADA, JYOJI;TAKAHASHI, MASAMI;REEL/FRAME:012309/0069

Effective date: 20010905

CC Certificate of correction
FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

FPAY Fee payment

Year of fee payment: 4

REMI Maintenance fee reminder mailed
LAPS Lapse for failure to pay maintenance fees
STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20110204